2024-09-22T02:52:12.944 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-22T02:52:12.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T02:52:13.049 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914713 branch: squid description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/admin_socket_objecter_requests} email: ceph-qa@ceph.com first_in_suite: false job_id: '7914713' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc osd_pool_default_min_size: 2 osd_pool_default_size: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 osd pool default crimson: true paxos service trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: snappy bluestore compression mode: aggressive bluestore fsck on mount: true bluestore rocksdb cf: false crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 err to stderr: true log flush on exit: true log to file: false log to stderr: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd debug reject backfill probability: 0.3 osd delete sleep: 1 osd failsafe full ratio: 0.95 osd max backfills: 3 osd max markdown count: 1000 osd objectstore: bluestore osd scrub max interval: 120 osd scrub min interval: 60 osd shutdown pgref assert: true osd snap trim sleep: 2 osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: crimson sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: min_in: 4 workunit: branch: squid env: CRIMSON_COMPAT: '1' sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b seed: 1158 sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 sleep_before_teardown: 0 subset: 0/1 suite: crimson-rados suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 targets: smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAKpPWUzSrkvjh+ivSi7o2EgjRDXKsjJPOIEAhLWrlG4Wl79AWlOdV+H8R4vKxqyyw0zlifNyJ+Crg9ay4s5ag= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEyDjLLeE9EbMW0jsR+8AdpIMpxLDAtKHA1sawq/DMZ3pAh8qcjHqkztVbZiDrbGMYtjeoGhjxFi3fW8FPvpNw8= tasks: - install: null - ceph: conf: osd: debug monc: 20 flavor: crimson - thrashosds: ceph_objectstore_tool: false chance_down: 0 chance_inject_pause_short: 0 chance_reset_purged_snaps_last: 0 chance_thrash_cluster_full: 0 chance_thrash_pg_upmap: 0 dump_ops_enable: false min_in: 3 noscrub_toggle_delay: 0 reweight_osd: 0 sighup_delay: 0 thrash_primary_affinity: false timeout: 2400 - radosbench: clients: - client.0 time: 150 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_21:56:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-22T02:52:13.049 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa; will attempt to use it 2024-09-22T02:52:13.050 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa/tasks 2024-09-22T02:52:13.050 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-22T02:52:13.052 INFO:teuthology.task.internal:Checking packages... 2024-09-22T02:52:13.074 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '4e45e6b490e6cbe082cdf155fea780438ec53fc7' 2024-09-22T02:52:13.075 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-22T02:52:13.075 INFO:teuthology.packaging:ref: None 2024-09-22T02:52:13.075 INFO:teuthology.packaging:tag: None 2024-09-22T02:52:13.075 INFO:teuthology.packaging:branch: squid 2024-09-22T02:52:13.075 INFO:teuthology.packaging:sha1: 4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T02:52:13.075 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-22T02:52:13.288 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-373.g4e45e6b4 2024-09-22T02:52:13.290 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-22T02:52:13.295 INFO:teuthology.task.internal:no buildpackages task found 2024-09-22T02:52:13.295 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-22T02:52:13.302 INFO:teuthology.task.internal:Saving configuration 2024-09-22T02:52:13.317 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-22T02:52:13.332 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-22T02:52:13.357 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914713', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 02:43:23.389714', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAKpPWUzSrkvjh+ivSi7o2EgjRDXKsjJPOIEAhLWrlG4Wl79AWlOdV+H8R4vKxqyyw0zlifNyJ+Crg9ay4s5ag='} 2024-09-22T02:52:13.380 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914713', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-22 02:43:23.388255', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEyDjLLeE9EbMW0jsR+8AdpIMpxLDAtKHA1sawq/DMZ3pAh8qcjHqkztVbZiDrbGMYtjeoGhjxFi3fW8FPvpNw8='} 2024-09-22T02:52:13.380 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-22T02:52:13.405 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-09-22T02:52:13.405 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-22T02:52:13.405 INFO:teuthology.run_tasks:Running task console_log... 2024-09-22T02:52:13.471 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd085540160>, signals=[15]) 2024-09-22T02:52:13.471 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-22T02:52:13.479 INFO:teuthology.task.internal:Opening connections... 2024-09-22T02:52:13.479 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-09-22T02:52:13.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:52:13.558 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-09-22T02:52:13.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:52:13.634 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-22T02:52:13.640 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-09-22T02:52:13.658 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-09-22T02:52:13.658 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-09-22T02:52:13.716 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-09-22T02:52:13.716 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-09-22T02:52:13.716 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-09-22T02:52:13.716 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-09-22T02:52:13.716 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-09-22T02:52:13.716 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-09-22T02:52:13.716 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T02:52:13.716 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-09-22T02:52:13.716 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-09-22T02:52:13.716 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T02:52:13.717 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-09-22T02:52:13.717 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T02:52:13.717 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T02:52:13.717 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T02:52:13.717 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-09-22T02:52:13.740 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-09-22T02:52:13.759 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-09-22T02:52:13.759 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-09-22T02:52:13.818 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-09-22T02:52:13.818 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-09-22T02:52:13.818 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-09-22T02:52:13.818 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-09-22T02:52:13.818 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-09-22T02:52:13.818 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-09-22T02:52:13.818 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-22T02:52:13.818 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-09-22T02:52:13.818 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-09-22T02:52:13.818 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-22T02:52:13.819 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-09-22T02:52:13.819 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-22T02:52:13.819 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-22T02:52:13.819 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-22T02:52:13.819 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-09-22T02:52:13.840 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-22T02:52:13.853 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-22T02:52:13.859 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-22T02:52:13.859 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-09-22T02:52:13.862 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-09-22T02:52:13.879 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-22T02:52:13.888 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-22T02:52:13.889 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-09-22T02:52:13.920 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-09-22T02:52:13.988 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-22T02:52:14.044 INFO:teuthology.run_tasks:Running task kernel... 2024-09-22T02:52:14.057 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-22T02:52:14.057 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-22T02:52:14.058 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T02:52:14.058 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-22T02:52:14.075 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T02:52:14.076 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-22T02:52:14.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T02:52:14.077 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-22T02:52:14.133 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-503.el9.x86_64 2024-09-22T02:52:14.133 INFO:teuthology.task.kernel:Running kernel on smithi145: 5.14.0-503.el9.x86_64 2024-09-22T02:52:14.134 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum install -y kernel 2024-09-22T02:52:14.135 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-503.el9.x86_64 2024-09-22T02:52:14.135 INFO:teuthology.task.kernel:Running kernel on smithi194: 5.14.0-503.el9.x86_64 2024-09-22T02:52:14.135 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum install -y kernel 2024-09-22T02:52:16.551 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-22T02:52:16.669 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-22T02:52:18.260 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-22T02:52:18.436 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-22T02:52:23.020 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 6.5 MB 00:00 2024-09-22T02:52:23.703 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.5 MB 00:01 2024-09-22T02:52:24.604 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 19 kB 00:00 2024-09-22T02:52:25.178 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 75 kB/s | 19 kB 00:00 2024-09-22T02:52:25.683 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-22T02:52:26.449 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-22T02:52:31.072 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-09-22T02:52:31.904 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-22T02:52:32.970 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T02:52:32.970 INFO:teuthology.orchestra.run.smithi145.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T02:52:33.054 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T02:52:33.060 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T02:52:33.060 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-09-22T02:52:33.060 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T02:52:33.060 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T02:52:33.060 INFO:teuthology.orchestra.run.smithi145.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T02:52:33.061 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-22T02:52:33.061 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T02:52:33.061 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T02:52:33.061 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T02:52:33.061 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T02:52:33.061 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T02:52:33.061 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T02:52:33.061 INFO:teuthology.orchestra.run.smithi145.stdout:Install 4 Packages 2024-09-22T02:52:33.061 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T02:52:33.062 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 79 M 2024-09-22T02:52:33.062 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 126 M 2024-09-22T02:52:33.062 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T02:52:33.264 INFO:teuthology.orchestra.run.smithi145.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 346 kB/s | 36 kB 00:00 2024-09-22T02:52:33.811 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-22T02:52:33.811 INFO:teuthology.orchestra.run.smithi194.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-22T02:52:33.907 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T02:52:33.915 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T02:52:33.915 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-09-22T02:52:33.916 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T02:52:33.916 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T02:52:33.916 INFO:teuthology.orchestra.run.smithi194.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-22T02:52:33.916 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-22T02:52:33.916 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-22T02:52:33.916 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-22T02:52:33.916 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-22T02:52:33.916 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T02:52:33.917 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T02:52:33.917 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T02:52:33.917 INFO:teuthology.orchestra.run.smithi194.stdout:Install 4 Packages 2024-09-22T02:52:33.917 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T02:52:33.917 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 79 M 2024-09-22T02:52:33.917 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 126 M 2024-09-22T02:52:33.917 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T02:52:34.047 INFO:teuthology.orchestra.run.smithi194.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 335 kB/s | 36 kB 00:00 2024-09-22T02:52:36.281 INFO:teuthology.orchestra.run.smithi145.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 5.0 MB/s | 16 MB 00:03 2024-09-22T02:52:37.806 INFO:teuthology.orchestra.run.smithi145.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 6.3 MB/s | 29 MB 00:04 2024-09-22T02:52:38.214 INFO:teuthology.orchestra.run.smithi194.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-09-22T02:52:38.856 INFO:teuthology.orchestra.run.smithi145.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 6.1 MB/s | 35 MB 00:05 2024-09-22T02:52:38.856 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T02:52:38.856 INFO:teuthology.orchestra.run.smithi145.stdout:Total 14 MB/s | 79 MB 00:05 2024-09-22T02:52:39.542 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T02:52:39.919 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T02:52:39.919 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T02:52:40.883 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T02:52:40.883 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T02:52:43.317 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T02:52:43.979 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T02:52:44.065 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T02:52:46.828 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T02:52:46.837 INFO:teuthology.orchestra.run.smithi194.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.2 MB/s | 29 MB 00:12 2024-09-22T02:52:46.969 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T02:52:50.054 INFO:teuthology.orchestra.run.smithi194.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.1 MB/s | 35 MB 00:16 2024-09-22T02:52:50.054 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T02:52:50.054 INFO:teuthology.orchestra.run.smithi194.stdout:Total 4.9 MB/s | 79 MB 00:16 2024-09-22T02:52:50.773 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T02:52:51.144 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T02:52:51.144 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T02:52:51.794 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T02:52:51.973 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:52:52.099 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T02:52:52.099 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T02:52:54.525 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T02:52:55.185 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-22T02:52:55.306 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T02:52:56.807 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:52:58.060 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T02:52:58.182 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T02:53:02.985 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T02:53:03.107 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:53:07.931 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:53:34.705 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:53:34.745 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:53:35.160 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:53:35.160 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T02:53:35.160 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T02:53:35.160 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T02:53:35.988 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:53:35.989 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T02:53:35.989 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T02:53:35.989 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T02:53:35.989 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T02:53:35.989 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T02:53:35.989 INFO:teuthology.orchestra.run.smithi145.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T02:53:35.989 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T02:53:35.989 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T02:53:36.338 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T02:53:36.422 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T02:53:36.423 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T02:53:36.423 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T02:53:36.423 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T02:53:36.423 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T02:53:36.423 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-22T02:53:36.423 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi145.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T02:53:36.423 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T02:53:36.482 INFO:teuthology.orchestra.run.smithi145.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T02:53:36.482 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T02:53:36.482 DEBUG:teuthology.orchestra.run.smithi145:> sudo rpm -qi grub2-tools 2024-09-22T02:53:36.514 INFO:teuthology.orchestra.run.smithi145.stdout:Name : grub2-tools 2024-09-22T02:53:36.514 INFO:teuthology.orchestra.run.smithi145.stdout:Epoch : 1 2024-09-22T02:53:36.514 INFO:teuthology.orchestra.run.smithi145.stdout:Version : 2.06 2024-09-22T02:53:36.514 INFO:teuthology.orchestra.run.smithi145.stdout:Release : 82.el9 2024-09-22T02:53:36.514 INFO:teuthology.orchestra.run.smithi145.stdout:Architecture: x86_64 2024-09-22T02:53:36.514 INFO:teuthology.orchestra.run.smithi145.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T02:53:36.514 INFO:teuthology.orchestra.run.smithi145.stdout:Group : Unspecified 2024-09-22T02:53:36.515 INFO:teuthology.orchestra.run.smithi145.stdout:Size : 8274670 2024-09-22T02:53:36.515 INFO:teuthology.orchestra.run.smithi145.stdout:License : GPLv3+ 2024-09-22T02:53:36.515 INFO:teuthology.orchestra.run.smithi145.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T02:53:36.515 INFO:teuthology.orchestra.run.smithi145.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T02:53:36.515 INFO:teuthology.orchestra.run.smithi145.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T02:53:36.515 INFO:teuthology.orchestra.run.smithi145.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T02:53:36.515 INFO:teuthology.orchestra.run.smithi145.stdout:Packager : builder@centos.org 2024-09-22T02:53:36.515 INFO:teuthology.orchestra.run.smithi145.stdout:Vendor : CentOS 2024-09-22T02:53:36.515 INFO:teuthology.orchestra.run.smithi145.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T02:53:36.515 INFO:teuthology.orchestra.run.smithi145.stdout:Summary : Support tools for GRUB. 2024-09-22T02:53:36.516 INFO:teuthology.orchestra.run.smithi145.stdout:Description : 2024-09-22T02:53:36.516 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T02:53:36.516 INFO:teuthology.orchestra.run.smithi145.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T02:53:36.516 INFO:teuthology.orchestra.run.smithi145.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T02:53:36.516 INFO:teuthology.orchestra.run.smithi145.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T02:53:36.516 INFO:teuthology.orchestra.run.smithi145.stdout:hardware devices. 2024-09-22T02:53:36.516 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T02:53:36.516 INFO:teuthology.orchestra.run.smithi145.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T02:53:36.517 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T02:53:36.517 INFO:teuthology.task.kernel:Updating grub on smithi145 to boot 5.14.0-508.el9.x86_64 2024-09-22T02:53:36.517 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T02:53:37.168 INFO:teuthology.orchestra.run.smithi145.stderr:Generating grub configuration file ... 2024-09-22T02:53:38.496 INFO:teuthology.orchestra.run.smithi145.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T02:53:38.526 INFO:teuthology.orchestra.run.smithi145.stderr:done 2024-09-22T02:53:38.528 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-09-22T02:53:38.543 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.cHEvZwIpRn 2024-09-22T02:53:38.544 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cHEvZwIpRn 2024-09-22T02:53:38.610 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.cHEvZwIpRn 2024-09-22T02:53:38.764 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.cHEvZwIpRn is 6KB 2024-09-22T02:53:38.784 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.cHEvZwIpRn 2024-09-22T02:53:38.799 DEBUG:teuthology.orchestra.run.smithi145:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T02:53:38.861 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T02:53:38.861 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T02:53:38.862 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T02:53:38.862 INFO:teuthology.orchestra.run.smithi145.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T02:53:38.863 DEBUG:teuthology.orchestra.run.smithi145:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T02:53:39.011 DEBUG:teuthology.orchestra.run.smithi145:> sudo shutdown -r now 2024-09-22T02:53:46.030 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:53:46.075 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:53:46.439 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:53:46.439 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-22T02:53:46.439 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-22T02:53:46.440 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-22T02:53:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-22T02:53:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T02:53:47.262 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T02:53:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-22T02:53:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-22T02:53:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-22T02:53:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-22T02:53:47.262 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T02:53:47.262 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T02:53:47.604 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T02:53:47.681 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T02:53:47.682 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T02:53:47.682 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-22T02:53:47.682 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-22T02:53:47.682 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-22T02:53:47.682 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-22T02:53:47.682 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=None, version=distro) 2024-09-22T02:53:47.682 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q kernel | sort -rV | head -n 1 2024-09-22T02:53:47.740 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-22T02:53:47.740 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-22T02:53:47.740 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2024-09-22T02:53:47.775 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2024-09-22T02:53:47.775 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2024-09-22T02:53:47.775 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.06 2024-09-22T02:53:47.775 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 82.el9 2024-09-22T02:53:47.775 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2024-09-22T02:53:47.775 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-22T02:53:47.775 INFO:teuthology.orchestra.run.smithi194.stdout:Group : Unspecified 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 8274670 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : builder@centos.org 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-22T02:53:47.776 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-22T02:53:47.777 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-22T02:53:47.777 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2024-09-22T02:53:47.777 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T02:53:47.777 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2024-09-22T02:53:47.777 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-22T02:53:47.778 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 5.14.0-508.el9.x86_64 2024-09-22T02:53:47.778 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-22T02:53:48.484 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-09-22T02:53:49.785 INFO:teuthology.orchestra.run.smithi194.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-22T02:53:49.821 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-09-22T02:53:49.823 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-22T02:53:49.839 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.AtoZol30HD 2024-09-22T02:53:49.840 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.AtoZol30HD 2024-09-22T02:53:49.906 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.AtoZol30HD 2024-09-22T02:53:50.041 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.AtoZol30HD is 6KB 2024-09-22T02:53:50.089 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.AtoZol30HD 2024-09-22T02:53:50.103 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2024-09-22T02:53:50.172 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-22T02:53:50.173 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-22T02:53:50.173 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-22T02:53:50.173 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-22T02:53:50.174 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-22T02:53:50.331 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-09-22T02:54:09.030 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-22T02:54:09.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-22T02:54:09.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:54:20.342 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-22T02:54:20.343 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-22T02:54:20.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:54:27.567 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-22T02:54:36.574 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-22T02:54:36.575 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:54:38.831 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-22T02:54:39.631 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-22T02:54:47.835 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-22T02:54:47.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:54:50.898 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-22T02:54:51.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-22T02:54:51.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:55:02.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-22T02:55:02.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:55:10.063 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-22T02:55:25.076 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-22T02:55:25.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:55:25.445 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-22T02:55:26.172 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-22T02:55:26.172 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-22T02:55:26.172 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-22T02:55:26.208 INFO:teuthology.orchestra.run.smithi145.stdout:5.14.0-508.el9.x86_64 2024-09-22T02:55:26.209 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T02:55:26.209 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T02:55:26.209 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T02:55:27.210 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-22T02:55:27.210 DEBUG:teuthology.orchestra.run.smithi145:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T02:55:27.391 INFO:teuthology.orchestra.run.smithi145.stdout:ttyS1 2024-09-22T02:55:27.423 DEBUG:teuthology.parallel:result is None 2024-09-22T02:55:34.723 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-22T02:55:35.392 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-22T02:55:35.392 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-22T02:55:35.393 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-22T02:55:35.440 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-508.el9.x86_64 2024-09-22T02:55:35.441 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-22T02:55:35.441 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-22T02:55:35.441 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-22T02:55:36.442 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-22T02:55:36.442 DEBUG:teuthology.orchestra.run.smithi194:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-22T02:55:36.769 INFO:teuthology.orchestra.run.smithi194.stdout:ttyS1 2024-09-22T02:55:36.798 DEBUG:teuthology.parallel:result is None 2024-09-22T02:55:36.798 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-22T02:55:36.807 INFO:teuthology.task.internal:Creating test directory... 2024-09-22T02:55:36.807 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T02:55:36.810 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-22T02:55:36.827 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-22T02:55:36.838 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-22T02:55:36.850 INFO:teuthology.task.internal:Creating archive directory... 2024-09-22T02:55:36.851 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T02:55:36.870 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-22T02:55:37.007 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-22T02:55:37.014 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-22T02:55:37.014 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T02:55:37.016 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-22T02:55:37.052 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T02:55:37.053 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T02:55:37.061 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T02:55:37.065 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-22T02:55:37.067 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-22T02:55:37.074 INFO:teuthology.task.internal:Configuring sudo... 2024-09-22T02:55:37.075 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T02:55:37.110 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-22T02:55:37.135 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-22T02:55:37.144 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-22T02:55:37.144 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T02:55:37.178 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-22T02:55:37.193 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T02:55:37.276 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T02:55:37.324 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T02:55:37.407 DEBUG:teuthology.orchestra.run.smithi145:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T02:55:37.447 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T02:55:37.447 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T02:55:37.514 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T02:55:37.555 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-22T02:55:37.605 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T02:55:37.681 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-22T02:55:37.726 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T02:55:37.726 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-22T02:55:37.790 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2024-09-22T02:55:37.792 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-09-22T02:55:37.835 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T02:55:37.873 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T02:55:38.381 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-22T02:55:38.388 INFO:teuthology.task.internal:Starting timer... 2024-09-22T02:55:38.388 INFO:teuthology.run_tasks:Running task pcp... 2024-09-22T02:55:38.460 INFO:teuthology.run_tasks:Running task selinux... 2024-09-22T02:55:38.471 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-22T02:55:38.471 DEBUG:teuthology.orchestra.run.smithi145:> sudo service auditd rotate 2024-09-22T02:55:38.526 INFO:teuthology.orchestra.run.smithi145.stdout:Rotating logs: 2024-09-22T02:55:38.528 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2024-09-22T02:55:38.570 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2024-09-22T02:55:38.572 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-22T02:55:38.572 DEBUG:teuthology.orchestra.run.smithi145:> /usr/sbin/getenforce 2024-09-22T02:55:38.606 INFO:teuthology.orchestra.run.smithi145.stdout:Permissive 2024-09-22T02:55:38.606 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2024-09-22T02:55:38.666 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2024-09-22T02:55:38.666 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi145.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2024-09-22T02:55:38.667 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-22T02:55:38.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T02:55:38.694 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-22T02:55:38.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T02:55:38.720 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-22T02:55:38.720 DEBUG:teuthology.orchestra.run.smithi145:> sudo /usr/sbin/setenforce permissive 2024-09-22T02:55:38.765 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2024-09-22T02:55:38.792 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-22T02:55:38.800 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-22T02:55:38.803 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-22T02:55:38.903 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-22T02:55:38.913 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-22T02:55:38.914 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi145.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-22T02:59:22.804 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi145.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-09-22T02:59:22.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-22T02:59:22.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:59:22.881 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-22T02:59:22.962 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-22T02:59:22.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-22T02:59:22.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-22T02:59:23.041 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-22T02:59:23.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-22T02:59:23.118 INFO:teuthology.run_tasks:Running task clock... 2024-09-22T02:59:23.129 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-22T02:59:23.129 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T02:59:23.130 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T02:59:23.132 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-22T02:59:23.132 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T02:59:23.162 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T02:59:23.177 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T02:59:23.188 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-22T02:59:23.202 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: ntpd: command not found 2024-09-22T02:59:23.202 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-22T02:59:23.213 INFO:teuthology.orchestra.run.smithi145.stdout:506 Cannot talk to daemon 2024-09-22T02:59:23.227 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2024-09-22T02:59:23.228 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T02:59:23.237 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2024-09-22T02:59:23.242 INFO:teuthology.orchestra.run.smithi145.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T02:59:23.251 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-22T02:59:23.265 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-22T02:59:23.299 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-09-22T02:59:23.303 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T02:59:23.303 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-09-22T02:59:23.303 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T02:59:23.303 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T02:59:23.303 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T02:59:23.303 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T02:59:23.323 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-22T02:59:23.327 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T02:59:23.328 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-22T02:59:23.328 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T02:59:23.328 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T02:59:23.328 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T02:59:23.328 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T02:59:23.328 INFO:teuthology.run_tasks:Running task install... 2024-09-22T02:59:23.339 DEBUG:teuthology.task.install:project ceph 2024-09-22T02:59:23.339 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}} 2024-09-22T02:59:23.340 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'} 2024-09-22T02:59:23.340 INFO:teuthology.task.install:Using flavor: crimson 2024-09-22T02:59:23.345 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-22T02:59:23.345 INFO:teuthology.task.install:extra packages: [] 2024-09-22T02:59:23.346 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'tag': None, 'wait_for_package': False} 2024-09-22T02:59:23.346 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T02:59:23.347 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'tag': None, 'wait_for_package': False} 2024-09-22T02:59:23.348 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T02:59:23.492 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/ 2024-09-22T02:59:23.492 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-22T02:59:23.495 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/ 2024-09-22T02:59:23.495 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-22T02:59:23.604 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T02:59:23.604 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T02:59:23.605 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T02:59:23.607 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-22T02:59:23.607 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T02:59:23.607 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-22T02:59:23.633 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-22T02:59:23.633 DEBUG:teuthology.orchestra.run.smithi145:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e45e6b490e6cbe082cdf155fea780438ec53fc7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T02:59:23.634 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-22T02:59:23.634 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4e45e6b490e6cbe082cdf155fea780438ec53fc7/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-22T02:59:23.699 DEBUG:teuthology.orchestra.run.smithi145:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T02:59:23.700 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-22T02:59:23.774 DEBUG:teuthology.orchestra.run.smithi145:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T02:59:23.775 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-22T02:59:23.838 INFO:teuthology.orchestra.run.smithi145.stdout:check_obsoletes = 1 2024-09-22T02:59:23.840 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum clean all 2024-09-22T02:59:23.841 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2024-09-22T02:59:23.841 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2024-09-22T02:59:24.065 INFO:teuthology.orchestra.run.smithi145.stdout:45 files removed 2024-09-22T02:59:24.079 INFO:teuthology.orchestra.run.smithi194.stdout:45 files removed 2024-09-22T02:59:24.093 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-radosgw 2024-09-22T02:59:24.107 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw 2024-09-22T02:59:24.642 INFO:teuthology.orchestra.run.smithi145.stdout:ceph packages for x86_64 327 kB/s | 87 kB 00:00 2024-09-22T02:59:24.656 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 329 kB/s | 87 kB 00:00 2024-09-22T02:59:24.926 INFO:teuthology.orchestra.run.smithi145.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-22T02:59:24.940 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-22T02:59:25.194 INFO:teuthology.orchestra.run.smithi145.stdout:ceph source packages 8.6 kB/s | 2.0 kB 00:00 2024-09-22T02:59:25.199 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 8.9 kB/s | 2.0 kB 00:00 2024-09-22T02:59:25.874 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-22T02:59:25.885 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-22T02:59:27.792 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-22T02:59:27.928 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-22T02:59:32.229 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-22T02:59:32.242 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.5 MB 00:00 2024-09-22T02:59:33.763 INFO:teuthology.orchestra.run.smithi145.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-22T02:59:33.876 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 19 kB 00:00 2024-09-22T02:59:34.876 INFO:teuthology.orchestra.run.smithi145.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-22T02:59:34.922 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-22T02:59:40.340 INFO:teuthology.orchestra.run.smithi145.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-09-22T02:59:40.361 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-22T02:59:42.567 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T02:59:42.581 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T02:59:42.581 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-22T02:59:42.581 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T02:59:42.581 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T02:59:42.581 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 9.9 M 2024-09-22T02:59:42.581 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrading: 2024-09-22T02:59:42.581 INFO:teuthology.orchestra.run.smithi145.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-22T02:59:42.581 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-22T02:59:42.581 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-22T02:59:42.581 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T02:59:42.581 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-22T02:59:42.581 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 19 M 2024-09-22T02:59:42.582 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-22T02:59:42.582 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T02:59:42.582 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T02:59:42.582 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T02:59:42.582 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 760 k 2024-09-22T02:59:42.582 INFO:teuthology.orchestra.run.smithi145.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T02:59:42.582 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T02:59:42.582 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T02:59:42.582 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 501 k 2024-09-22T02:59:42.582 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T02:59:42.582 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.1 M 2024-09-22T02:59:42.582 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T02:59:42.582 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 161 k 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 301 k 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout:Installing weak dependencies: 2024-09-22T02:59:42.583 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T02:59:42.584 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T02:59:42.584 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T02:59:42.584 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T02:59:42.584 INFO:teuthology.orchestra.run.smithi145.stdout:Install 30 Packages 2024-09-22T02:59:42.584 INFO:teuthology.orchestra.run.smithi145.stdout:Upgrade 2 Packages 2024-09-22T02:59:42.584 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T02:59:42.584 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 58 M 2024-09-22T02:59:42.584 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T02:59:42.587 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T02:59:42.601 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T02:59:42.601 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-22T02:59:42.601 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T02:59:42.601 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T02:59:42.602 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 9.9 M 2024-09-22T02:59:42.602 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2024-09-22T02:59:42.602 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-22T02:59:42.602 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-22T02:59:42.602 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-22T02:59:42.602 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-22T02:59:42.602 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-22T02:59:42.602 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 19 M 2024-09-22T02:59:42.602 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-22T02:59:42.602 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-22T02:59:42.602 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-22T02:59:42.602 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-22T02:59:42.602 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 760 k 2024-09-22T02:59:42.603 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-22T02:59:42.603 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-22T02:59:42.603 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-22T02:59:42.603 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 501 k 2024-09-22T02:59:42.603 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-22T02:59:42.603 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.1 M 2024-09-22T02:59:42.603 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-22T02:59:42.603 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-22T02:59:42.603 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-22T02:59:42.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-22T02:59:42.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-22T02:59:42.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 161 k 2024-09-22T02:59:42.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 301 k 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout:Installing weak dependencies: 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout:Install 30 Packages 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 2 Packages 2024-09-22T02:59:42.604 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T02:59:42.605 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 58 M 2024-09-22T02:59:42.605 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T02:59:43.400 INFO:teuthology.orchestra.run.smithi145.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 10 MB/s | 5.4 MB 00:00 2024-09-22T02:59:43.458 INFO:teuthology.orchestra.run.smithi145.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 432 kB/s | 25 kB 00:00 2024-09-22T02:59:43.567 INFO:teuthology.orchestra.run.smithi145.stdout:(3/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 6.9 MB/s | 760 kB 00:00 2024-09-22T02:59:43.675 INFO:teuthology.orchestra.run.smithi145.stdout:(4/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 12 MB/s | 9.9 MB 00:00 2024-09-22T02:59:43.701 INFO:teuthology.orchestra.run.smithi145.stdout:(5/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 3.7 MB/s | 501 kB 00:00 2024-09-22T02:59:43.768 INFO:teuthology.orchestra.run.smithi145.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 676 kB/s | 45 kB 00:00 2024-09-22T02:59:43.843 INFO:teuthology.orchestra.run.smithi145.stdout:(7/32): python3-ceph-common-19.1.1-373.g4e45e6b 1.8 MB/s | 136 kB 00:00 2024-09-22T02:59:43.918 INFO:teuthology.orchestra.run.smithi145.stdout:(8/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 2.1 MB/s | 161 kB 00:00 2024-09-22T02:59:43.994 INFO:teuthology.orchestra.run.smithi145.stdout:(9/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_64 16 MB/s | 5.1 MB 00:00 2024-09-22T02:59:44.019 INFO:teuthology.orchestra.run.smithi145.stdout:(10/32): python3-rados-19.1.1-373.g4e45e6b4.el9 3.1 MB/s | 321 kB 00:00 2024-09-22T02:59:44.052 INFO:teuthology.orchestra.run.smithi145.stdout:(11/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 5.0 MB/s | 301 kB 00:00 2024-09-22T02:59:44.078 INFO:teuthology.orchestra.run.smithi145.stdout:(12/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 1.7 MB/s | 99 kB 00:00 2024-09-22T02:59:44.095 INFO:teuthology.orchestra.run.smithi194.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 4.7 MB/s | 5.4 MB 00:01 2024-09-22T02:59:44.137 INFO:teuthology.orchestra.run.smithi194.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 605 kB/s | 25 kB 00:00 2024-09-22T02:59:44.212 INFO:teuthology.orchestra.run.smithi194.stdout:(3/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 9.9 MB/s | 760 kB 00:00 2024-09-22T02:59:44.270 INFO:teuthology.orchestra.run.smithi145.stdout:(13/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x 14 MB/s | 19 MB 00:01 2024-09-22T02:59:44.279 INFO:teuthology.orchestra.run.smithi194.stdout:(4/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 7.3 MB/s | 501 kB 00:00 2024-09-22T02:59:44.328 INFO:teuthology.orchestra.run.smithi145.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 388 kB/s | 107 kB 00:00 2024-09-22T02:59:44.354 INFO:teuthology.orchestra.run.smithi145.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 581 kB/s | 160 kB 00:00 2024-09-22T02:59:44.379 INFO:teuthology.orchestra.run.smithi145.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-22T02:59:44.421 INFO:teuthology.orchestra.run.smithi145.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 662 kB 00:00 2024-09-22T02:59:44.446 INFO:teuthology.orchestra.run.smithi145.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 632 kB/s | 42 kB 00:00 2024-09-22T02:59:44.471 INFO:teuthology.orchestra.run.smithi145.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-22T02:59:44.497 INFO:teuthology.orchestra.run.smithi145.stdout:(20/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-22T02:59:44.522 INFO:teuthology.orchestra.run.smithi145.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 474 kB/s | 36 kB 00:00 2024-09-22T02:59:44.547 INFO:teuthology.orchestra.run.smithi145.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-09-22T02:59:44.563 INFO:teuthology.orchestra.run.smithi194.stdout:(5/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_64 18 MB/s | 5.1 MB 00:00 2024-09-22T02:59:44.605 INFO:teuthology.orchestra.run.smithi194.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 1.1 MB/s | 45 kB 00:00 2024-09-22T02:59:44.614 INFO:teuthology.orchestra.run.smithi145.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-22T02:59:44.639 INFO:teuthology.orchestra.run.smithi145.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 333 kB/s | 26 kB 00:00 2024-09-22T02:59:44.655 INFO:teuthology.orchestra.run.smithi194.stdout:(7/32): python3-ceph-common-19.1.1-373.g4e45e6b 2.7 MB/s | 136 kB 00:00 2024-09-22T02:59:44.665 INFO:teuthology.orchestra.run.smithi145.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 964 kB/s | 49 kB 00:00 2024-09-22T02:59:44.690 INFO:teuthology.orchestra.run.smithi145.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-22T02:59:44.705 INFO:teuthology.orchestra.run.smithi194.stdout:(8/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 3.2 MB/s | 161 kB 00:00 2024-09-22T02:59:44.732 INFO:teuthology.orchestra.run.smithi145.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-22T02:59:44.755 INFO:teuthology.orchestra.run.smithi194.stdout:(9/32): python3-rados-19.1.1-373.g4e45e6b4.el9. 6.3 MB/s | 321 kB 00:00 2024-09-22T02:59:44.765 INFO:teuthology.orchestra.run.smithi145.stdout:(28/32): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-22T02:59:44.806 INFO:teuthology.orchestra.run.smithi194.stdout:(10/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 5.9 MB/s | 301 kB 00:00 2024-09-22T02:59:44.848 INFO:teuthology.orchestra.run.smithi194.stdout:(11/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 2.3 MB/s | 99 kB 00:00 2024-09-22T02:59:44.849 INFO:teuthology.orchestra.run.smithi145.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-22T02:59:44.941 INFO:teuthology.orchestra.run.smithi145.stdout:(30/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 18 MB/s | 3.2 MB 00:00 2024-09-22T02:59:44.981 INFO:teuthology.orchestra.run.smithi194.stdout:(12/32): boost-program-options-1.75.0-8.el9.x86 802 kB/s | 107 kB 00:00 2024-09-22T02:59:45.016 INFO:teuthology.orchestra.run.smithi145.stdout:(31/32): libarrow-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-09-22T02:59:45.056 INFO:teuthology.orchestra.run.smithi194.stdout:(13/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-22T02:59:45.091 INFO:teuthology.orchestra.run.smithi145.stdout:(32/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 13 MB/s | 3.1 MB 00:00 2024-09-22T02:59:45.096 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T02:59:45.096 INFO:teuthology.orchestra.run.smithi145.stdout:Total 23 MB/s | 58 MB 00:02 2024-09-22T02:59:45.107 INFO:teuthology.orchestra.run.smithi194.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-09-22T02:59:45.196 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T02:59:45.232 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T02:59:45.232 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T02:59:45.274 INFO:teuthology.orchestra.run.smithi194.stdout:(15/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-22T02:59:45.391 INFO:teuthology.orchestra.run.smithi194.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 292 kB 00:00 2024-09-22T02:59:45.441 INFO:teuthology.orchestra.run.smithi194.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 845 kB/s | 42 kB 00:00 2024-09-22T02:59:45.525 INFO:teuthology.orchestra.run.smithi194.stdout:(18/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-22T02:59:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:(19/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9. 3.6 MB/s | 9.9 MB 00:02 2024-09-22T02:59:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 215 kB/s | 36 kB 00:00 2024-09-22T02:59:45.734 INFO:teuthology.orchestra.run.smithi194.stdout:(21/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 7.2 MB/s | 308 kB 00:00 2024-09-22T02:59:45.784 INFO:teuthology.orchestra.run.smithi194.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-22T02:59:45.826 INFO:teuthology.orchestra.run.smithi194.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 624 kB/s | 26 kB 00:00 2024-09-22T02:59:45.851 INFO:teuthology.orchestra.run.smithi194.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-22T02:59:45.868 INFO:teuthology.orchestra.run.smithi194.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 3.9 MB/s | 67 kB 00:00 2024-09-22T02:59:45.915 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T02:59:45.915 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T02:59:45.927 INFO:teuthology.orchestra.run.smithi194.stdout:(26/32): libarrow-9.0.0-11.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-22T02:59:45.960 INFO:teuthology.orchestra.run.smithi194.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-22T02:59:46.019 INFO:teuthology.orchestra.run.smithi194.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 839 kB 00:00 2024-09-22T02:59:46.061 INFO:teuthology.orchestra.run.smithi194.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-22T02:59:46.295 INFO:teuthology.orchestra.run.smithi194.stdout:(30/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 12 MB/s | 3.2 MB 00:00 2024-09-22T02:59:46.636 INFO:teuthology.orchestra.run.smithi194.stdout:(31/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 5.4 MB/s | 3.1 MB 00:00 2024-09-22T02:59:47.011 INFO:teuthology.orchestra.run.smithi194.stdout:(32/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x 4.8 MB/s | 19 MB 00:04 2024-09-22T02:59:47.017 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T02:59:47.017 INFO:teuthology.orchestra.run.smithi194.stdout:Total 13 MB/s | 58 MB 00:04 2024-09-22T02:59:47.124 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T02:59:47.160 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T02:59:47.160 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T02:59:47.373 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T02:59:47.750 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-22T02:59:47.819 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T02:59:47.819 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T02:59:47.863 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-22T02:59:47.954 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-22T02:59:48.045 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-22T02:59:48.072 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-22T02:59:48.140 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-22T02:59:48.168 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/34 2024-09-22T02:59:48.193 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/34 2024-09-22T02:59:48.216 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 7/34 2024-09-22T02:59:48.237 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 7/34 2024-09-22T02:59:48.376 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 8/34 2024-09-22T02:59:48.404 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 8/34 2024-09-22T02:59:48.434 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/34 2024-09-22T02:59:48.477 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 10/34 2024-09-22T02:59:48.507 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-22T02:59:48.573 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 12/34 2024-09-22T02:59:48.595 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-22T02:59:48.683 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-22T02:59:48.736 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : thrift-0.15.0-2.el9.x86_64 14/34 2024-09-22T02:59:48.855 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-22T02:59:48.895 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-22T02:59:48.936 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-22T02:59:48.969 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-22T02:59:48.998 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-22T02:59:49.030 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-22T02:59:49.268 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T02:59:49.360 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-22T02:59:49.401 INFO:teuthology.orchestra.run.smithi145.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-22T02:59:49.493 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-22T02:59:49.523 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-22T02:59:49.559 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-22T02:59:49.699 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-22T02:59:49.755 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-22T02:59:49.831 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-22T02:59:49.921 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-22T02:59:49.948 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-22T02:59:50.034 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-22T02:59:50.053 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-22T02:59:50.064 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/34 2024-09-22T02:59:50.111 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 6/34 2024-09-22T02:59:50.120 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-22T02:59:50.133 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 7/34 2024-09-22T02:59:50.153 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 7/34 2024-09-22T02:59:50.201 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-22T02:59:50.278 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-22T02:59:50.306 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-22T02:59:50.350 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 8/34 2024-09-22T02:59:50.389 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 8/34 2024-09-22T02:59:50.418 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/34 2024-09-22T02:59:50.462 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 10/34 2024-09-22T02:59:50.491 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-22T02:59:50.571 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 12/34 2024-09-22T02:59:50.596 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-22T02:59:50.685 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-22T02:59:50.728 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.15.0-2.el9.x86_64 14/34 2024-09-22T02:59:50.840 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-22T02:59:50.879 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-22T02:59:50.920 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-22T02:59:50.952 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-22T02:59:50.982 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-22T02:59:51.027 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-22T02:59:51.363 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-22T02:59:51.402 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-22T02:59:51.493 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-22T02:59:51.523 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-22T02:59:51.567 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-22T02:59:52.056 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-22T02:59:52.088 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-22T02:59:52.159 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-22T02:59:52.236 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-22T02:59:52.265 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-22T02:59:52.527 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-22T02:59:52.569 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-22T02:59:53.140 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-22T02:59:53.181 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-22T02:59:53.274 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-22T02:59:53.274 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T02:59:53.274 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T02:59:53.274 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T02:59:53.324 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-22T02:59:54.461 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-22T02:59:54.503 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-22T02:59:55.094 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-22T02:59:55.131 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-22T02:59:55.222 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-22T02:59:55.223 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-22T02:59:55.223 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-22T02:59:55.223 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T02:59:55.257 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-22T03:00:03.666 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-22T03:00:03.666 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /sys 2024-09-22T03:00:03.666 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /proc 2024-09-22T03:00:03.666 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /mnt 2024-09-22T03:00:03.667 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /var/tmp 2024-09-22T03:00:03.667 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /home 2024-09-22T03:00:03.667 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /root 2024-09-22T03:00:03.667 INFO:teuthology.orchestra.run.smithi145.stdout:skipping the directory /tmp 2024-09-22T03:00:03.667 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:00:04.657 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-22T03:00:04.683 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-22T03:00:04.683 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:00:04.683 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T03:00:04.683 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:00:04.683 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:00:04.683 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:00:04.685 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-22T03:00:04.776 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-22T03:00:04.777 INFO:teuthology.orchestra.run.smithi145.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-22T03:00:05.234 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-22T03:00:05.234 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2024-09-22T03:00:05.234 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2024-09-22T03:00:05.234 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2024-09-22T03:00:05.234 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2024-09-22T03:00:05.234 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2024-09-22T03:00:05.235 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /root 2024-09-22T03:00:05.235 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2024-09-22T03:00:05.235 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:00:06.015 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-22T03:00:06.015 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-22T03:00:06.015 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-22T03:00:06.015 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-22T03:00:06.015 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-22T03:00:06.015 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-22T03:00:06.015 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-22T03:00:06.015 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-22T03:00:06.016 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-22T03:00:06.017 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-22T03:00:06.017 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-22T03:00:06.017 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-22T03:00:06.017 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-22T03:00:06.017 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-22T03:00:06.017 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-22T03:00:06.017 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-22T03:00:06.017 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-22T03:00:06.017 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-22T03:00:06.017 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-22T03:00:06.018 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-22T03:00:06.018 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-22T03:00:06.239 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-22T03:00:06.264 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-22T03:00:06.264 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:00:06.264 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-22T03:00:06.264 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:00:06.264 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-22T03:00:06.264 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:00:06.266 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-22T03:00:06.357 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-22T03:00:06.358 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-22T03:00:07.119 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-22T03:00:07.119 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:00:07.119 INFO:teuthology.orchestra.run.smithi145.stdout:Upgraded: 2024-09-22T03:00:07.119 INFO:teuthology.orchestra.run.smithi145.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.119 INFO:teuthology.orchestra.run.smithi145.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.119 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:00:07.119 INFO:teuthology.orchestra.run.smithi145.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T03:00:07.119 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.119 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.119 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.119 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T03:00:07.120 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.121 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.121 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.121 INFO:teuthology.orchestra.run.smithi145.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T03:00:07.121 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.121 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.121 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:07.121 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T03:00:07.121 INFO:teuthology.orchestra.run.smithi145.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T03:00:07.121 INFO:teuthology.orchestra.run.smithi145.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T03:00:07.121 INFO:teuthology.orchestra.run.smithi145.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T03:00:07.121 INFO:teuthology.orchestra.run.smithi145.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T03:00:07.121 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:00:07.121 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:00:07.423 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-test 2024-09-22T03:00:07.570 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-22T03:00:07.570 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-22T03:00:07.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-22T03:00:07.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-22T03:00:07.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-22T03:00:07.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-22T03:00:07.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-22T03:00:07.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-22T03:00:07.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-22T03:00:07.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-22T03:00:07.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-22T03:00:07.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-22T03:00:07.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-22T03:00:07.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-22T03:00:07.571 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-22T03:00:07.572 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-22T03:00:07.572 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-22T03:00:07.572 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-22T03:00:07.572 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-22T03:00:07.572 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-22T03:00:07.572 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-22T03:00:07.572 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-22T03:00:07.572 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-22T03:00:07.572 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-22T03:00:07.572 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-22T03:00:07.572 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-22T03:00:07.572 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-22T03:00:07.572 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-22T03:00:07.573 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-22T03:00:07.573 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-22T03:00:07.573 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-22T03:00:07.573 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-22T03:00:07.573 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-22T03:00:07.573 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-22T03:00:07.994 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:00:27 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:00:08.126 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:00:08.126 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:00:08.127 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-22T03:00:08.127 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:00:08.127 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:00:08.127 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 124 M 2024-09-22T03:00:08.127 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-22T03:00:08.127 INFO:teuthology.orchestra.run.smithi145.stdout: libasan x86_64 11.5.0-2.el9 appstream 414 k 2024-09-22T03:00:08.127 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 158 k 2024-09-22T03:00:08.127 INFO:teuthology.orchestra.run.smithi145.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-22T03:00:08.127 INFO:teuthology.orchestra.run.smithi145.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T03:00:08.127 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T03:00:08.127 INFO:teuthology.orchestra.run.smithi145.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-22T03:00:08.127 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:00:08.127 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:00:08.128 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:00:08.128 INFO:teuthology.orchestra.run.smithi145.stdout:Install 7 Packages 2024-09-22T03:00:08.128 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:00:08.128 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 125 M 2024-09-22T03:00:08.128 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 1.1 G 2024-09-22T03:00:08.128 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:00:08.347 INFO:teuthology.orchestra.run.smithi145.stdout:(1/7): libasan-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 414 kB 00:00 2024-09-22T03:00:08.406 INFO:teuthology.orchestra.run.smithi145.stdout:(2/7): libubsan-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-22T03:00:08.431 INFO:teuthology.orchestra.run.smithi145.stdout:(3/7): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 630 kB/s | 158 kB 00:00 2024-09-22T03:00:08.456 INFO:teuthology.orchestra.run.smithi145.stdout:(4/7): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-22T03:00:08.515 INFO:teuthology.orchestra.run.smithi145.stdout:(5/7): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.0 MB/s | 122 kB 00:00 2024-09-22T03:00:08.540 INFO:teuthology.orchestra.run.smithi145.stdout:(6/7): xmlstarlet-1.6.1-20.el9.x86_64.rpm 585 kB/s | 64 kB 00:00 2024-09-22T03:00:08.625 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-22T03:00:08.625 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:00:08.626 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2024-09-22T03:00:08.626 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.626 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.626 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:00:08.626 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-22T03:00:08.626 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.626 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.626 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.626 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.626 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-22T03:00:08.626 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-22T03:00:08.626 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-22T03:00:08.626 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-22T03:00:08.627 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.628 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.628 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:08.628 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-22T03:00:08.628 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-22T03:00:08.628 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-22T03:00:08.628 INFO:teuthology.orchestra.run.smithi194.stdout: re2-1:20211101-20.el9.x86_64 2024-09-22T03:00:08.628 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-22T03:00:08.628 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:00:08.628 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:00:08.903 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-test 2024-09-22T03:00:09.473 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:00:29 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:00:09.606 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:00:09.607 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:00:09.607 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-22T03:00:09.607 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:00:09.607 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:00:09.607 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 124 M 2024-09-22T03:00:09.607 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-22T03:00:09.607 INFO:teuthology.orchestra.run.smithi194.stdout: libasan x86_64 11.5.0-2.el9 appstream 414 k 2024-09-22T03:00:09.607 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 158 k 2024-09-22T03:00:09.607 INFO:teuthology.orchestra.run.smithi194.stdout: libubsan x86_64 11.5.0-2.el9 appstream 183 k 2024-09-22T03:00:09.607 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-22T03:00:09.607 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-22T03:00:09.607 INFO:teuthology.orchestra.run.smithi194.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-09-22T03:00:09.607 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:00:09.608 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:00:09.608 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:00:09.608 INFO:teuthology.orchestra.run.smithi194.stdout:Install 7 Packages 2024-09-22T03:00:09.608 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:00:09.608 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 125 M 2024-09-22T03:00:09.608 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 1.1 G 2024-09-22T03:00:09.608 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:00:10.120 INFO:teuthology.orchestra.run.smithi194.stdout:(1/7): libasan-11.5.0-2.el9.x86_64.rpm 2.4 MB/s | 414 kB 00:00 2024-09-22T03:00:10.162 INFO:teuthology.orchestra.run.smithi194.stdout:(2/7): libubsan-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 183 kB 00:00 2024-09-22T03:00:10.212 INFO:teuthology.orchestra.run.smithi194.stdout:(3/7): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-22T03:00:10.254 INFO:teuthology.orchestra.run.smithi194.stdout:(4/7): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-22T03:00:10.313 INFO:teuthology.orchestra.run.smithi194.stdout:(5/7): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.0 MB/s | 122 kB 00:00 2024-09-22T03:00:10.380 INFO:teuthology.orchestra.run.smithi194.stdout:(6/7): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 366 kB/s | 158 kB 00:00 2024-09-22T03:00:11.740 INFO:teuthology.orchestra.run.smithi145.stdout:(7/7): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 35 MB/s | 124 MB 00:03 2024-09-22T03:00:11.744 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:00:11.744 INFO:teuthology.orchestra.run.smithi145.stdout:Total 35 MB/s | 125 MB 00:03 2024-09-22T03:00:11.797 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:00:11.817 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:00:11.817 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:00:12.644 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:00:12.645 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:00:13.699 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:00:13.765 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/7 2024-09-22T03:00:13.771 INFO:teuthology.orchestra.run.smithi194.stdout:(7/7): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 32 MB/s | 124 MB 00:03 2024-09-22T03:00:13.774 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:00:13.775 INFO:teuthology.orchestra.run.smithi194.stdout:Total 30 MB/s | 125 MB 00:04 2024-09-22T03:00:13.808 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/7 2024-09-22T03:00:13.828 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:00:13.841 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/7 2024-09-22T03:00:13.849 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:00:13.850 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:00:13.875 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 4/7 2024-09-22T03:00:13.916 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libasan-11.5.0-2.el9.x86_64 5/7 2024-09-22T03:00:13.943 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/7 2024-09-22T03:00:14.675 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:00:14.675 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:00:15.736 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:00:15.810 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/7 2024-09-22T03:00:15.856 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/7 2024-09-22T03:00:15.895 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 3/7 2024-09-22T03:00:15.939 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libubsan-11.5.0-2.el9.x86_64 4/7 2024-09-22T03:00:15.985 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libasan-11.5.0-2.el9.x86_64 5/7 2024-09-22T03:00:16.016 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/7 2024-09-22T03:00:31.111 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/7 2024-09-22T03:00:31.181 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/7 2024-09-22T03:00:33.273 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/7 2024-09-22T03:00:33.354 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/7 2024-09-22T03:00:39.824 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/7 2024-09-22T03:00:39.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/7 2024-09-22T03:00:39.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/7 2024-09-22T03:00:39.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libasan-11.5.0-2.el9.x86_64 3/7 2024-09-22T03:00:39.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 4/7 2024-09-22T03:00:39.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 5/7 2024-09-22T03:00:39.824 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/7 2024-09-22T03:00:40.207 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 7/7 2024-09-22T03:00:40.207 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:00:40.207 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:00:40.207 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:40.207 INFO:teuthology.orchestra.run.smithi145.stdout: libasan-11.5.0-2.el9.x86_64 2024-09-22T03:00:40.208 INFO:teuthology.orchestra.run.smithi145.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:40.208 INFO:teuthology.orchestra.run.smithi145.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-22T03:00:40.208 INFO:teuthology.orchestra.run.smithi145.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T03:00:40.208 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T03:00:40.208 INFO:teuthology.orchestra.run.smithi145.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-22T03:00:40.208 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:00:40.208 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:00:40.525 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph 2024-09-22T03:00:41.111 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:01 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:00:41.253 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:00:41.256 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:00:41.256 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-22T03:00:41.256 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:00:41.256 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:00:41.256 INFO:teuthology.orchestra.run.smithi145.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-22T03:00:41.256 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-22T03:00:41.256 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.3 M 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.9 M 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 120 M 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T03:00:41.257 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T03:00:41.258 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T03:00:41.259 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T03:00:41.259 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T03:00:41.259 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T03:00:41.259 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T03:00:41.259 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T03:00:41.259 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T03:00:41.259 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T03:00:41.259 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T03:00:41.259 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:00:41.259 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:00:41.259 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:00:41.259 INFO:teuthology.orchestra.run.smithi145.stdout:Install 38 Packages 2024-09-22T03:00:41.259 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:00:41.260 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 134 M 2024-09-22T03:00:41.260 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 1.4 G 2024-09-22T03:00:41.260 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:00:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/7 2024-09-22T03:00:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/7 2024-09-22T03:00:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/7 2024-09-22T03:00:41.519 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libasan-11.5.0-2.el9.x86_64 3/7 2024-09-22T03:00:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libubsan-11.5.0-2.el9.x86_64 4/7 2024-09-22T03:00:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 5/7 2024-09-22T03:00:41.520 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/7 2024-09-22T03:00:41.904 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 7/7 2024-09-22T03:00:41.905 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:00:41.905 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:00:41.905 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:41.905 INFO:teuthology.orchestra.run.smithi194.stdout: libasan-11.5.0-2.el9.x86_64 2024-09-22T03:00:41.905 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:00:41.905 INFO:teuthology.orchestra.run.smithi194.stdout: libubsan-11.5.0-2.el9.x86_64 2024-09-22T03:00:41.905 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-22T03:00:41.905 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-22T03:00:41.905 INFO:teuthology.orchestra.run.smithi194.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-09-22T03:00:41.905 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:00:41.906 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:00:41.949 INFO:teuthology.orchestra.run.smithi145.stdout:(1/38): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 55 kB/s | 6.6 kB 00:00 2024-09-22T03:00:42.149 INFO:teuthology.orchestra.run.smithi145.stdout:(2/38): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 7.1 MB/s | 2.3 MB 00:00 2024-09-22T03:00:42.179 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph 2024-09-22T03:00:42.183 INFO:teuthology.orchestra.run.smithi145.stdout:(3/38): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 4.3 MB/s | 1.5 MB 00:00 2024-09-22T03:00:42.258 INFO:teuthology.orchestra.run.smithi145.stdout:(4/38): ceph-mgr-modules-core-19.1.1-373.g4e45e 3.3 MB/s | 249 kB 00:00 2024-09-22T03:00:42.375 INFO:teuthology.orchestra.run.smithi145.stdout:(5/38): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-22T03:00:42.442 INFO:teuthology.orchestra.run.smithi145.stdout:(6/38): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 9.9 MB/s | 4.9 MB 00:00 2024-09-22T03:00:42.492 INFO:teuthology.orchestra.run.smithi145.stdout:(7/38): python3-cryptography-36.0.1-4.el9.x86_6 10 MB/s | 1.2 MB 00:00 2024-09-22T03:00:42.534 INFO:teuthology.orchestra.run.smithi145.stdout:(8/38): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-22T03:00:42.560 INFO:teuthology.orchestra.run.smithi145.stdout:(9/38): python3-ply-3.11-14.el9.noarch.rpm 908 kB/s | 106 kB 00:00 2024-09-22T03:00:42.585 INFO:teuthology.orchestra.run.smithi145.stdout:(10/38): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-22T03:00:42.635 INFO:teuthology.orchestra.run.smithi145.stdout:(11/38): python3-urllib3-1.26.5-6.el9.noarch.rp 2.8 MB/s | 215 kB 00:00 2024-09-22T03:00:42.764 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:02 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:00:42.897 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:00:42.900 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:00:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-22T03:00:42.900 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:00:42.900 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:00:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-22T03:00:42.900 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-22T03:00:42.900 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.3 M 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.9 M 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 120 M 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-22T03:00:42.901 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-22T03:00:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-22T03:00:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-22T03:00:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-22T03:00:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-22T03:00:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-22T03:00:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-22T03:00:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-22T03:00:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-22T03:00:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-22T03:00:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-22T03:00:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-22T03:00:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-22T03:00:42.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-22T03:00:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-22T03:00:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-22T03:00:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-22T03:00:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-22T03:00:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-22T03:00:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-22T03:00:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-22T03:00:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-22T03:00:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:00:42.903 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:00:42.903 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:00:42.903 INFO:teuthology.orchestra.run.smithi194.stdout:Install 38 Packages 2024-09-22T03:00:42.903 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:00:42.904 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 134 M 2024-09-22T03:00:42.904 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 1.4 G 2024-09-22T03:00:42.904 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:00:43.136 INFO:teuthology.orchestra.run.smithi145.stdout:(12/38): lua-5.4.4-4.el9.x86_64.rpm 342 kB/s | 188 kB 00:00 2024-09-22T03:00:43.333 INFO:teuthology.orchestra.run.smithi194.stdout:(1/38): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 32 kB/s | 6.6 kB 00:00 2024-09-22T03:00:43.336 INFO:teuthology.orchestra.run.smithi145.stdout:(13/38): python3-mako-1.1.4-6.el9.noarch.rpm 861 kB/s | 172 kB 00:00 2024-09-22T03:00:43.461 INFO:teuthology.orchestra.run.smithi145.stdout:(14/38): python3-markupsafe-1.1.1-12.el9.x86_64 278 kB/s | 35 kB 00:00 2024-09-22T03:00:43.545 INFO:teuthology.orchestra.run.smithi145.stdout:(15/38): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-22T03:00:43.570 INFO:teuthology.orchestra.run.smithi145.stdout:(16/38): python3-packaging-20.9-5.el9.noarch.rp 711 kB/s | 77 kB 00:00 2024-09-22T03:00:43.654 INFO:teuthology.orchestra.run.smithi145.stdout:(17/38): python3-pytz-2021.1-5.el9.noarch.rpm 470 kB/s | 51 kB 00:00 2024-09-22T03:00:43.679 INFO:teuthology.orchestra.run.smithi145.stdout:(18/38): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-22T03:00:43.691 INFO:teuthology.orchestra.run.smithi194.stdout:(2/38): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 2.7 MB/s | 1.5 MB 00:00 2024-09-22T03:00:43.738 INFO:teuthology.orchestra.run.smithi145.stdout:(19/38): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2024-09-22T03:00:43.763 INFO:teuthology.orchestra.run.smithi145.stdout:(20/38): lua-devel-5.4.4-4.el9.x86_64.rpm 204 kB/s | 22 kB 00:00 2024-09-22T03:00:43.780 INFO:teuthology.orchestra.run.smithi145.stdout:(21/38): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-09-22T03:00:43.830 INFO:teuthology.orchestra.run.smithi145.stdout:(22/38): python3-cherrypy-18.6.1-2.el9.noarch.r 8.1 MB/s | 358 kB 00:00 2024-09-22T03:00:43.855 INFO:teuthology.orchestra.run.smithi145.stdout:(23/38): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-22T03:00:43.881 INFO:teuthology.orchestra.run.smithi145.stdout:(24/38): python3-jaraco-8.2.1-3.el9.noarch.rpm 212 kB/s | 11 kB 00:00 2024-09-22T03:00:43.906 INFO:teuthology.orchestra.run.smithi145.stdout:(25/38): python3-jaraco-classes-3.2.1-5.el9.noa 351 kB/s | 18 kB 00:00 2024-09-22T03:00:43.932 INFO:teuthology.orchestra.run.smithi145.stdout:(26/38): python3-jaraco-collections-3.0.0-8.el9 461 kB/s | 23 kB 00:00 2024-09-22T03:00:43.968 INFO:teuthology.orchestra.run.smithi145.stdout:(27/38): python3-jaraco-functools-3.5.0-2.el9.n 315 kB/s | 19 kB 00:00 2024-09-22T03:00:43.993 INFO:teuthology.orchestra.run.smithi145.stdout:(28/38): python3-jaraco-text-3.2.0-6.el9.noarch 317 kB/s | 20 kB 00:00 2024-09-22T03:00:44.018 INFO:teuthology.orchestra.run.smithi145.stdout:(29/38): python3-logutils-0.3.5-21.el9.noarch.r 921 kB/s | 46 kB 00:00 2024-09-22T03:00:44.044 INFO:teuthology.orchestra.run.smithi145.stdout:(30/38): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-22T03:00:44.069 INFO:teuthology.orchestra.run.smithi145.stdout:(31/38): python3-portend-3.1.0-2.el9.noarch.rpm 657 kB/s | 16 kB 00:00 2024-09-22T03:00:44.095 INFO:teuthology.orchestra.run.smithi145.stdout:(32/38): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-22T03:00:44.120 INFO:teuthology.orchestra.run.smithi145.stdout:(33/38): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-22T03:00:44.161 INFO:teuthology.orchestra.run.smithi145.stdout:(34/38): python3-tempora-5.0.0-2.el9.noarch.rpm 537 kB/s | 36 kB 00:00 2024-09-22T03:00:44.195 INFO:teuthology.orchestra.run.smithi145.stdout:(35/38): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-22T03:00:44.221 INFO:teuthology.orchestra.run.smithi145.stdout:(36/38): python3-zc-lockfile-2.0-10.el9.noarch. 789 kB/s | 20 kB 00:00 2024-09-22T03:00:44.263 INFO:teuthology.orchestra.run.smithi145.stdout:(37/38): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.1 MB/s | 427 kB 00:00 2024-09-22T03:00:44.275 INFO:teuthology.orchestra.run.smithi194.stdout:(3/38): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 5.2 MB/s | 4.9 MB 00:00 2024-09-22T03:00:44.375 INFO:teuthology.orchestra.run.smithi194.stdout:(4/38): ceph-mgr-modules-core-19.1.1-373.g4e45e 2.4 MB/s | 249 kB 00:00 2024-09-22T03:00:44.500 INFO:teuthology.orchestra.run.smithi194.stdout:(5/38): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-22T03:00:44.767 INFO:teuthology.orchestra.run.smithi194.stdout:(6/38): python3-cryptography-36.0.1-4.el9.x86_6 4.6 MB/s | 1.2 MB 00:00 2024-09-22T03:00:44.826 INFO:teuthology.orchestra.run.smithi194.stdout:(7/38): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-22T03:00:44.901 INFO:teuthology.orchestra.run.smithi194.stdout:(8/38): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-09-22T03:00:44.960 INFO:teuthology.orchestra.run.smithi194.stdout:(9/38): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-22T03:00:45.052 INFO:teuthology.orchestra.run.smithi194.stdout:(10/38): python3-urllib3-1.26.5-6.el9.noarch.rp 2.3 MB/s | 215 kB 00:00 2024-09-22T03:00:45.552 INFO:teuthology.orchestra.run.smithi194.stdout:(11/38): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_ 962 kB/s | 2.3 MB 00:02 2024-09-22T03:00:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:(12/38): lua-5.4.4-4.el9.x86_64.rpm 294 kB/s | 188 kB 00:00 2024-09-22T03:00:45.986 INFO:teuthology.orchestra.run.smithi194.stdout:(13/38): python3-mako-1.1.4-6.el9.noarch.rpm 591 kB/s | 172 kB 00:00 2024-09-22T03:00:46.094 INFO:teuthology.orchestra.run.smithi194.stdout:(14/38): python3-markupsafe-1.1.1-12.el9.x86_64 321 kB/s | 35 kB 00:00 2024-09-22T03:00:46.171 INFO:teuthology.orchestra.run.smithi145.stdout:(38/38): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_ 30 MB/s | 120 MB 00:04 2024-09-22T03:00:46.176 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:00:46.176 INFO:teuthology.orchestra.run.smithi145.stdout:Total 27 MB/s | 134 MB 00:04 2024-09-22T03:00:46.211 INFO:teuthology.orchestra.run.smithi194.stdout:(15/38): python3-packaging-20.9-5.el9.noarch.rp 663 kB/s | 77 kB 00:00 2024-09-22T03:00:46.328 INFO:teuthology.orchestra.run.smithi194.stdout:(16/38): python3-pytz-2021.1-5.el9.noarch.rpm 438 kB/s | 51 kB 00:00 2024-09-22T03:00:46.346 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:00:46.362 INFO:teuthology.orchestra.run.smithi194.stdout:(17/38): protobuf-3.14.0-13.el9.x86_64.rpm 1.2 MB/s | 1.0 MB 00:00 2024-09-22T03:00:46.386 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:00:46.387 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:00:46.437 INFO:teuthology.orchestra.run.smithi194.stdout:(18/38): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-22T03:00:46.487 INFO:teuthology.orchestra.run.smithi194.stdout:(19/38): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-22T03:00:46.512 INFO:teuthology.orchestra.run.smithi194.stdout:(20/38): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-22T03:00:46.538 INFO:teuthology.orchestra.run.smithi194.stdout:(21/38): python3-cheroot-8.6.0-4.el9.noarch.rpm 6.8 MB/s | 172 kB 00:00 2024-09-22T03:00:46.571 INFO:teuthology.orchestra.run.smithi194.stdout:(22/38): python3-cherrypy-18.6.1-2.el9.noarch.r 11 MB/s | 358 kB 00:00 2024-09-22T03:00:46.597 INFO:teuthology.orchestra.run.smithi194.stdout:(23/38): python3-jaraco-8.2.1-3.el9.noarch.rpm 430 kB/s | 11 kB 00:00 2024-09-22T03:00:46.630 INFO:teuthology.orchestra.run.smithi194.stdout:(24/38): python3-jaraco-classes-3.2.1-5.el9.noa 690 kB/s | 18 kB 00:00 2024-09-22T03:00:46.655 INFO:teuthology.orchestra.run.smithi194.stdout:(25/38): python3-jaraco-collections-3.0.0-8.el9 927 kB/s | 23 kB 00:00 2024-09-22T03:00:46.681 INFO:teuthology.orchestra.run.smithi194.stdout:(26/38): python3-jaraco-functools-3.5.0-2.el9.n 780 kB/s | 19 kB 00:00 2024-09-22T03:00:46.706 INFO:teuthology.orchestra.run.smithi194.stdout:(27/38): python3-jaraco-text-3.2.0-6.el9.noarch 815 kB/s | 20 kB 00:00 2024-09-22T03:00:46.740 INFO:teuthology.orchestra.run.smithi194.stdout:(28/38): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2024-09-22T03:00:46.765 INFO:teuthology.orchestra.run.smithi194.stdout:(29/38): python3-more-itertools-8.12.0-2.el9.no 3.1 MB/s | 79 kB 00:00 2024-09-22T03:00:46.799 INFO:teuthology.orchestra.run.smithi194.stdout:(30/38): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-22T03:00:46.824 INFO:teuthology.orchestra.run.smithi194.stdout:(31/38): python3-portend-3.1.0-2.el9.noarch.rpm 660 kB/s | 16 kB 00:00 2024-09-22T03:00:46.858 INFO:teuthology.orchestra.run.smithi194.stdout:(32/38): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.6 MB/s | 90 kB 00:00 2024-09-22T03:00:46.883 INFO:teuthology.orchestra.run.smithi194.stdout:(33/38): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-22T03:00:46.916 INFO:teuthology.orchestra.run.smithi194.stdout:(34/38): python3-webob-1.8.8-2.el9.noarch.rpm 6.8 MB/s | 230 kB 00:00 2024-09-22T03:00:46.942 INFO:teuthology.orchestra.run.smithi194.stdout:(35/38): lua-devel-5.4.4-4.el9.x86_64.rpm 38 kB/s | 22 kB 00:00 2024-09-22T03:00:46.983 INFO:teuthology.orchestra.run.smithi194.stdout:(36/38): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.3 MB/s | 427 kB 00:00 2024-09-22T03:00:47.009 INFO:teuthology.orchestra.run.smithi194.stdout:(37/38): python3-zc-lockfile-2.0-10.el9.noarch. 299 kB/s | 20 kB 00:00 2024-09-22T03:00:47.507 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:00:47.507 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:00:48.084 INFO:teuthology.orchestra.run.smithi194.stdout:(38/38): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_ 27 MB/s | 120 MB 00:04 2024-09-22T03:00:48.089 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:00:48.089 INFO:teuthology.orchestra.run.smithi194.stdout:Total 26 MB/s | 134 MB 00:05 2024-09-22T03:00:48.263 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:00:48.304 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:00:48.304 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:00:49.382 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:00:49.383 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:00:49.483 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:00:49.607 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/38 2024-09-22T03:00:49.645 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/38 2024-09-22T03:00:49.685 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/38 2024-09-22T03:00:49.756 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/38 2024-09-22T03:00:49.809 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/38 2024-09-22T03:00:49.841 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/38 2024-09-22T03:00:49.933 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/38 2024-09-22T03:00:50.019 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/38 2024-09-22T03:00:50.069 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/38 2024-09-22T03:00:50.104 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/38 2024-09-22T03:00:50.134 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/38 2024-09-22T03:00:50.168 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/38 2024-09-22T03:00:50.202 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/38 2024-09-22T03:00:50.251 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/38 2024-09-22T03:00:50.294 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/38 2024-09-22T03:00:50.328 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/38 2024-09-22T03:00:50.376 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/38 2024-09-22T03:00:50.409 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/38 2024-09-22T03:00:50.483 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/38 2024-09-22T03:00:50.629 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/38 2024-09-22T03:00:50.689 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/38 2024-09-22T03:00:51.370 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:00:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/38 2024-09-22T03:00:51.474 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/38 2024-09-22T03:00:51.505 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/38 2024-09-22T03:00:51.575 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/38 2024-09-22T03:00:51.621 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/38 2024-09-22T03:00:51.675 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/38 2024-09-22T03:00:51.771 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/38 2024-09-22T03:00:51.849 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/38 2024-09-22T03:00:51.905 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/38 2024-09-22T03:00:51.939 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/38 2024-09-22T03:00:51.969 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/38 2024-09-22T03:00:51.996 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/38 2024-09-22T03:00:52.029 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/38 2024-09-22T03:00:52.070 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/38 2024-09-22T03:00:52.104 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/38 2024-09-22T03:00:52.139 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/38 2024-09-22T03:00:52.187 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/38 2024-09-22T03:00:52.219 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/38 2024-09-22T03:00:52.292 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/38 2024-09-22T03:00:52.438 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/38 2024-09-22T03:00:52.491 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/38 2024-09-22T03:01:09.581 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/38 2024-09-22T03:01:09.612 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/38 2024-09-22T03:01:09.642 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/38 2024-09-22T03:01:09.642 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:01:09.642 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T03:01:09.642 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:01:09.642 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:01:09.643 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:09.745 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/38 2024-09-22T03:01:09.783 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/38 2024-09-22T03:01:09.832 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-ply-3.11-14.el9.noarch 26/38 2024-09-22T03:01:09.887 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 27/38 2024-09-22T03:01:10.072 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 28/38 2024-09-22T03:01:10.120 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 29/38 2024-09-22T03:01:10.198 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/38 2024-09-22T03:01:10.287 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 31/38 2024-09-22T03:01:10.328 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 32/38 2024-09-22T03:01:10.445 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 33/38 2024-09-22T03:01:10.628 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 34/38 2024-09-22T03:01:10.663 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/38 2024-09-22T03:01:10.688 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/38 2024-09-22T03:01:10.688 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:01:10.688 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T03:01:10.688 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:01:10.688 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:01:10.688 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:11.164 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/38 2024-09-22T03:01:11.188 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/38 2024-09-22T03:01:11.188 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:01:11.188 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T03:01:11.188 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:01:11.188 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:01:11.188 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:11.415 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/38 2024-09-22T03:01:11.435 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 22/38 2024-09-22T03:01:11.439 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/38 2024-09-22T03:01:11.439 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:01:11.439 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T03:01:11.439 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:01:11.439 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:01:11.439 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:11.471 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/38 2024-09-22T03:01:11.501 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/38 2024-09-22T03:01:11.501 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:01:11.502 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-22T03:01:11.502 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:01:11.502 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-22T03:01:11.502 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:11.502 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 38/38 2024-09-22T03:01:11.605 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/38 2024-09-22T03:01:11.643 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/38 2024-09-22T03:01:11.692 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ply-3.11-14.el9.noarch 26/38 2024-09-22T03:01:11.747 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 27/38 2024-09-22T03:01:11.931 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 28/38 2024-09-22T03:01:11.980 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 29/38 2024-09-22T03:01:12.058 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/38 2024-09-22T03:01:12.146 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 31/38 2024-09-22T03:01:12.188 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 32/38 2024-09-22T03:01:12.303 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 33/38 2024-09-22T03:01:12.471 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 34/38 2024-09-22T03:01:12.498 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/38 2024-09-22T03:01:12.522 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/38 2024-09-22T03:01:12.522 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:01:12.522 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-22T03:01:12.523 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:01:12.523 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-22T03:01:12.523 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:12.990 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/38 2024-09-22T03:01:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/38 2024-09-22T03:01:13.014 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:01:13.014 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-22T03:01:13.014 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:01:13.014 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-22T03:01:13.014 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:13.241 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/38 2024-09-22T03:01:13.264 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/38 2024-09-22T03:01:13.264 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:01:13.265 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-22T03:01:13.265 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:01:13.265 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-22T03:01:13.265 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:13.328 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 38/38 2024-09-22T03:01:21.977 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 38/38 2024-09-22T03:01:21.977 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/38 2024-09-22T03:01:21.977 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/38 2024-09-22T03:01:21.977 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/38 2024-09-22T03:01:21.977 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/38 2024-09-22T03:01:21.977 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/38 2024-09-22T03:01:21.977 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/38 2024-09-22T03:01:21.977 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/38 2024-09-22T03:01:21.977 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 14/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 15/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 16/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 17/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 18/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 19/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 20/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 21/38 2024-09-22T03:01:21.978 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 22/38 2024-09-22T03:01:21.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 23/38 2024-09-22T03:01:21.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 24/38 2024-09-22T03:01:21.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 25/38 2024-09-22T03:01:21.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 26/38 2024-09-22T03:01:21.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 27/38 2024-09-22T03:01:21.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 28/38 2024-09-22T03:01:21.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 29/38 2024-09-22T03:01:21.979 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 30/38 2024-09-22T03:01:21.980 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 31/38 2024-09-22T03:01:21.980 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 32/38 2024-09-22T03:01:21.980 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 33/38 2024-09-22T03:01:21.980 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 34/38 2024-09-22T03:01:21.980 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 35/38 2024-09-22T03:01:21.980 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 36/38 2024-09-22T03:01:21.981 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 37/38 2024-09-22T03:01:22.784 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 38/38 2024-09-22T03:01:22.785 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:22.785 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:01:22.785 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:22.785 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:22.785 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:22.785 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:22.785 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:22.785 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:22.785 INFO:teuthology.orchestra.run.smithi145.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T03:01:22.785 INFO:teuthology.orchestra.run.smithi145.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T03:01:22.785 INFO:teuthology.orchestra.run.smithi145.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T03:01:22.786 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T03:01:22.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T03:01:22.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T03:01:22.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T03:01:22.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T03:01:22.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T03:01:22.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T03:01:22.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T03:01:22.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T03:01:22.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T03:01:22.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T03:01:22.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T03:01:22.786 INFO:teuthology.orchestra.run.smithi145.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T03:01:22.787 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T03:01:22.788 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T03:01:22.788 INFO:teuthology.orchestra.run.smithi145.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T03:01:22.788 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:22.788 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:01:23.077 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-base 2024-09-22T03:01:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 38/38 2024-09-22T03:01:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/38 2024-09-22T03:01:23.135 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 14/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 15/38 2024-09-22T03:01:23.136 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 16/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 17/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 18/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 19/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 20/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 21/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 22/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 23/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 24/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 25/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 26/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 27/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 28/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 29/38 2024-09-22T03:01:23.137 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 30/38 2024-09-22T03:01:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 31/38 2024-09-22T03:01:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 32/38 2024-09-22T03:01:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 33/38 2024-09-22T03:01:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 34/38 2024-09-22T03:01:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 35/38 2024-09-22T03:01:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 36/38 2024-09-22T03:01:23.138 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 37/38 2024-09-22T03:01:23.651 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:43 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:23.739 INFO:teuthology.orchestra.run.smithi145.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:01:23.786 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:01:23.787 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-22T03:01:23.787 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:01:23.851 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install cephadm 2024-09-22T03:01:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 38/38 2024-09-22T03:01:24.195 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:24.196 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:01:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: lua-5.4.4-4.el9.x86_64 2024-09-22T03:01:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-22T03:01:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-22T03:01:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-22T03:01:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-22T03:01:24.196 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-22T03:01:24.197 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-22T03:01:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply-3.11-14.el9.noarch 2024-09-22T03:01:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-22T03:01:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-22T03:01:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-22T03:01:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-22T03:01:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-22T03:01:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-22T03:01:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-22T03:01:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-22T03:01:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-22T03:01:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-22T03:01:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-22T03:01:24.198 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:24.199 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:01:24.423 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:44 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:24.474 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-base 2024-09-22T03:01:24.553 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:01:24.554 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:24.554 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-22T03:01:24.554 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:24.554 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:01:24.555 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-22T03:01:24.555 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:24.555 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:01:24.555 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:24.555 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-22T03:01:24.555 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:24.556 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 765 k 2024-09-22T03:01:24.556 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 771 k 2024-09-22T03:01:24.556 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:01:24.838 INFO:teuthology.orchestra.run.smithi145.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.6 MB/s | 765 kB 00:00 2024-09-22T03:01:24.838 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:24.839 INFO:teuthology.orchestra.run.smithi145.stdout:Total 2.6 MB/s | 765 kB 00:00 2024-09-22T03:01:24.839 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:01:24.844 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:01:24.844 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:01:24.850 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:01:24.850 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:01:24.927 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:01:25.056 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:45 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:25.144 INFO:teuthology.orchestra.run.smithi194.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:01:25.186 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:01:25.187 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-22T03:01:25.187 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:01:25.257 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install cephadm 2024-09-22T03:01:25.323 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:01:25.417 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:01:25.805 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:01:25.829 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:45 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:25.961 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:01:25.962 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-22T03:01:25.962 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:25.962 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:01:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-22T03:01:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:25.962 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:01:25.962 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:25.962 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-22T03:01:25.962 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:25.963 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 765 k 2024-09-22T03:01:25.963 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 771 k 2024-09-22T03:01:25.963 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:01:26.041 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:01:26.041 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:26.041 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:01:26.041 INFO:teuthology.orchestra.run.smithi145.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:26.042 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:26.042 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:01:26.249 INFO:teuthology.orchestra.run.smithi194.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.6 MB/s | 765 kB 00:00 2024-09-22T03:01:26.250 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:26.251 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.6 MB/s | 765 kB 00:00 2024-09-22T03:01:26.251 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:01:26.256 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:01:26.256 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:01:26.261 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:01:26.262 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:01:26.269 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-immutable-object-cache 2024-09-22T03:01:26.335 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:01:26.727 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:01:26.812 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:01:26.854 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:46 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:26.988 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:01:26.988 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:26.989 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repo Size 2024-09-22T03:01:26.989 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:26.989 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:01:26.989 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 147 k 2024-09-22T03:01:26.989 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:26.989 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:01:26.989 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:26.989 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-22T03:01:26.989 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:26.989 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 147 k 2024-09-22T03:01:26.989 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 481 k 2024-09-22T03:01:26.989 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:01:27.181 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:01:27.204 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 688 kB/s | 147 kB 00:00 2024-09-22T03:01:27.204 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:27.205 INFO:teuthology.orchestra.run.smithi145.stdout:Total 683 kB/s | 147 kB 00:00 2024-09-22T03:01:27.205 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:01:27.212 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:01:27.212 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:01:27.268 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:01:27.268 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:01:27.413 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:01:27.446 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:01:27.446 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:27.446 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:01:27.446 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:27.446 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:27.446 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:01:27.496 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-22T03:01:27.522 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-22T03:01:27.522 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:01:27.522 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T03:01:27.523 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:27.662 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-immutable-object-cache 2024-09-22T03:01:28.257 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:48 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:28.398 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:01:28.398 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:28.399 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2024-09-22T03:01:28.399 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:28.399 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:01:28.399 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 147 k 2024-09-22T03:01:28.399 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:28.399 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:01:28.399 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:28.399 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-22T03:01:28.399 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:28.400 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 147 k 2024-09-22T03:01:28.400 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 481 k 2024-09-22T03:01:28.400 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:01:28.497 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-22T03:01:28.497 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:28.497 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:01:28.497 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:28.497 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:28.497 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:01:28.722 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 457 kB/s | 147 kB 00:00 2024-09-22T03:01:28.723 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:28.724 INFO:teuthology.orchestra.run.smithi194.stdout:Total 454 kB/s | 147 kB 00:00 2024-09-22T03:01:28.724 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:01:28.731 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-mgr 2024-09-22T03:01:28.732 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:01:28.732 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:01:28.790 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:01:28.791 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:01:28.930 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:01:28.998 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-22T03:01:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-22T03:01:29.024 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:01:29.024 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-22T03:01:29.024 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:29.328 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:49 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:29.419 INFO:teuthology.orchestra.run.smithi145.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:01:29.462 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:01:29.463 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-22T03:01:29.463 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:01:29.529 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-mgr-dashboard 2024-09-22T03:01:29.972 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-22T03:01:29.972 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:29.972 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:01:29.972 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:01:29.972 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:29.972 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:01:30.103 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:50 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:30.182 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr 2024-09-22T03:01:30.234 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:01:30.235 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:30.235 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-22T03:01:30.236 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:30.236 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:01:30.236 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-22T03:01:30.236 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-22T03:01:30.236 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T03:01:30.236 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-22T03:01:30.236 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-22T03:01:30.236 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T03:01:30.236 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T03:01:30.236 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T03:01:30.236 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T03:01:30.236 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T03:01:30.236 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T03:01:30.237 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T03:01:30.237 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:30.237 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:01:30.237 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:30.237 INFO:teuthology.orchestra.run.smithi145.stdout:Install 11 Packages 2024-09-22T03:01:30.237 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:30.237 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 7.7 M 2024-09-22T03:01:30.238 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 101 M 2024-09-22T03:01:30.238 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:01:30.775 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:50 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:30.865 INFO:teuthology.orchestra.run.smithi194.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:01:30.907 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:01:30.908 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-22T03:01:30.908 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:01:30.976 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-dashboard 2024-09-22T03:01:31.557 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:51 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:31.689 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:01:31.690 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:31.690 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-22T03:01:31.690 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:31.690 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:01:31.690 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:01:31.691 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:31.692 INFO:teuthology.orchestra.run.smithi194.stdout:Install 11 Packages 2024-09-22T03:01:31.692 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:31.692 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 7.7 M 2024-09-22T03:01:31.692 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 101 M 2024-09-22T03:01:31.692 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:01:32.390 INFO:teuthology.orchestra.run.smithi145.stdout:(1/11): ceph-grafana-dashboards-19.1.1-373.g4e4 206 kB/s | 32 kB 00:00 2024-09-22T03:01:32.415 INFO:teuthology.orchestra.run.smithi145.stdout:(2/11): ceph-prometheus-alerts-19.1.1-373.g4e45 92 kB/s | 16 kB 00:00 2024-09-22T03:01:32.541 INFO:teuthology.orchestra.run.smithi145.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 1.8 MB/s | 269 kB 00:00 2024-09-22T03:01:32.633 INFO:teuthology.orchestra.run.smithi145.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 5.9 MB/s | 548 kB 00:00 2024-09-22T03:01:32.658 INFO:teuthology.orchestra.run.smithi145.stdout:(5/11): protobuf-compiler-3.14.0-13.el9.x86_64. 3.5 MB/s | 863 kB 00:00 2024-09-22T03:01:32.683 INFO:teuthology.orchestra.run.smithi145.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-09-22T03:01:32.734 INFO:teuthology.orchestra.run.smithi145.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.3 MB/s | 144 kB 00:00 2024-09-22T03:01:32.759 INFO:teuthology.orchestra.run.smithi145.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-22T03:01:32.801 INFO:teuthology.orchestra.run.smithi145.stdout:(9/11): python3-routes-2.5.1-5.el9.noarch.rpm 4.4 MB/s | 188 kB 00:00 2024-09-22T03:01:32.926 INFO:teuthology.orchestra.run.smithi145.stdout:(10/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 7.6 MB/s | 2.0 MB 00:00 2024-09-22T03:01:33.027 INFO:teuthology.orchestra.run.smithi145.stdout:(11/11): ceph-mgr-dashboard-19.1.1-373.g4e45e6b 4.5 MB/s | 3.6 MB 00:00 2024-09-22T03:01:33.031 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:33.032 INFO:teuthology.orchestra.run.smithi145.stdout:Total 2.7 MB/s | 7.7 MB 00:02 2024-09-22T03:01:33.065 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:01:33.084 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:01:33.084 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:01:33.225 INFO:teuthology.orchestra.run.smithi194.stdout:(1/11): ceph-grafana-dashboards-19.1.1-373.g4e4 213 kB/s | 32 kB 00:00 2024-09-22T03:01:33.250 INFO:teuthology.orchestra.run.smithi194.stdout:(2/11): ceph-prometheus-alerts-19.1.1-373.g4e45 94 kB/s | 16 kB 00:00 2024-09-22T03:01:33.286 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:01:33.287 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:01:33.475 INFO:teuthology.orchestra.run.smithi194.stdout:(3/11): protobuf-compiler-3.14.0-13.el9.x86_64. 3.7 MB/s | 863 kB 00:00 2024-09-22T03:01:33.592 INFO:teuthology.orchestra.run.smithi194.stdout:(4/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.6 MB/s | 548 kB 00:00 2024-09-22T03:01:33.617 INFO:teuthology.orchestra.run.smithi194.stdout:(5/11): grpc-data-1.46.7-10.el9.noarch.rpm 808 kB/s | 19 kB 00:00 2024-09-22T03:01:33.768 INFO:teuthology.orchestra.run.smithi194.stdout:(6/11): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 5.2 MB/s | 3.6 MB 00:00 2024-09-22T03:01:33.775 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:01:33.826 INFO:teuthology.orchestra.run.smithi194.stdout:(7/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.4 MB/s | 144 kB 00:00 2024-09-22T03:01:33.852 INFO:teuthology.orchestra.run.smithi194.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-22T03:01:33.867 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-22T03:01:33.897 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-22T03:01:33.902 INFO:teuthology.orchestra.run.smithi194.stdout:(9/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 7.2 MB/s | 2.0 MB 00:00 2024-09-22T03:01:33.935 INFO:teuthology.orchestra.run.smithi194.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2024-09-22T03:01:34.008 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-22T03:01:34.094 INFO:teuthology.orchestra.run.smithi194.stdout:(11/11): python3-protobuf-3.14.0-13.el9.noarch. 310 kB/s | 269 kB 00:00 2024-09-22T03:01:34.100 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:34.100 INFO:teuthology.orchestra.run.smithi194.stdout:Total 3.2 MB/s | 7.7 MB 00:02 2024-09-22T03:01:34.133 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:01:34.139 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-22T03:01:34.152 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:01:34.152 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:01:34.199 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-22T03:01:34.283 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-22T03:01:34.327 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-22T03:01:34.355 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:01:34.362 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:01:34.363 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:01:34.387 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 9/11 2024-09-22T03:01:34.858 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:01:34.950 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-09-22T03:01:35.006 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-09-22T03:01:35.114 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-09-22T03:01:35.239 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-09-22T03:01:35.283 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-09-22T03:01:35.376 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-09-22T03:01:35.427 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-09-22T03:01:35.444 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 10/11 2024-09-22T03:01:35.455 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:01:35.495 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 9/11 2024-09-22T03:01:35.496 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 11/11 2024-09-22T03:01:36.548 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 10/11 2024-09-22T03:01:36.579 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 11/11 2024-09-22T03:01:36.758 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 11/11 2024-09-22T03:01:36.758 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/11 2024-09-22T03:01:36.758 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/11 2024-09-22T03:01:36.758 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/11 2024-09-22T03:01:36.759 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-22T03:01:36.759 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-22T03:01:36.759 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-22T03:01:36.759 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-22T03:01:36.759 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:01:36.759 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-22T03:01:36.759 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-22T03:01:37.104 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-22T03:01:37.104 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:37.104 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:01:37.104 INFO:teuthology.orchestra.run.smithi145.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T03:01:37.105 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:37.105 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:37.105 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:37.105 INFO:teuthology.orchestra.run.smithi145.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T03:01:37.105 INFO:teuthology.orchestra.run.smithi145.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T03:01:37.105 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T03:01:37.105 INFO:teuthology.orchestra.run.smithi145.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T03:01:37.105 INFO:teuthology.orchestra.run.smithi145.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T03:01:37.105 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T03:01:37.105 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T03:01:37.105 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:37.105 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:01:37.459 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-22T03:01:37.836 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 11/11 2024-09-22T03:01:37.836 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/11 2024-09-22T03:01:37.836 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/11 2024-09-22T03:01:37.836 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/11 2024-09-22T03:01:37.837 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-09-22T03:01:37.837 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-09-22T03:01:37.837 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-09-22T03:01:37.837 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-09-22T03:01:37.837 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-09-22T03:01:37.837 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-09-22T03:01:37.837 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-09-22T03:01:38.039 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:01:58 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-09-22T03:01:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:38.145 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:01:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-22T03:01:38.145 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-22T03:01:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-22T03:01:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-22T03:01:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-22T03:01:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-22T03:01:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-22T03:01:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-22T03:01:38.146 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:38.146 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:01:38.171 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:01:38.172 INFO:teuthology.orchestra.run.smithi145.stdout:====================================================================================== 2024-09-22T03:01:38.172 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-22T03:01:38.172 INFO:teuthology.orchestra.run.smithi145.stdout:====================================================================================== 2024-09-22T03:01:38.172 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:01:38.172 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-22T03:01:38.172 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-22T03:01:38.172 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T03:01:38.172 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T03:01:38.172 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T03:01:38.173 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T03:01:38.173 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T03:01:38.173 INFO:teuthology.orchestra.run.smithi145.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T03:01:38.173 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T03:01:38.173 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T03:01:38.173 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T03:01:38.173 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T03:01:38.173 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T03:01:38.173 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:38.173 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:01:38.173 INFO:teuthology.orchestra.run.smithi145.stdout:====================================================================================== 2024-09-22T03:01:38.173 INFO:teuthology.orchestra.run.smithi145.stdout:Install 12 Packages 2024-09-22T03:01:38.173 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:38.174 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 38 M 2024-09-22T03:01:38.174 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 212 M 2024-09-22T03:01:38.174 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:01:38.399 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-22T03:01:38.534 INFO:teuthology.orchestra.run.smithi145.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.0 MB/s | 191 kB 00:00 2024-09-22T03:01:38.568 INFO:teuthology.orchestra.run.smithi145.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-22T03:01:38.901 INFO:teuthology.orchestra.run.smithi145.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 89 kB/s | 33 kB 00:00 2024-09-22T03:01:38.983 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:01:58 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:39.068 INFO:teuthology.orchestra.run.smithi145.stdout:(4/12): ceph-mgr-diskprediction-local-19.1.1-37 10 MB/s | 7.4 MB 00:00 2024-09-22T03:01:39.093 INFO:teuthology.orchestra.run.smithi145.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 95 kB/s | 18 kB 00:00 2024-09-22T03:01:39.118 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:01:39.119 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-22T03:01:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-22T03:01:39.119 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-22T03:01:39.119 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:01:39.119 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-22T03:01:39.119 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:01:39.120 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-22T03:01:39.121 INFO:teuthology.orchestra.run.smithi194.stdout:Install 12 Packages 2024-09-22T03:01:39.121 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:39.121 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 38 M 2024-09-22T03:01:39.121 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 212 M 2024-09-22T03:01:39.121 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:01:39.210 INFO:teuthology.orchestra.run.smithi145.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 272 kB/s | 38 kB 00:00 2024-09-22T03:01:39.317 INFO:teuthology.orchestra.run.smithi194.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-22T03:01:39.367 INFO:teuthology.orchestra.run.smithi194.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.4 MB/s | 801 kB 00:00 2024-09-22T03:01:39.369 INFO:teuthology.orchestra.run.smithi145.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2024-09-22T03:01:39.451 INFO:teuthology.orchestra.run.smithi194.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-09-22T03:01:39.452 INFO:teuthology.orchestra.run.smithi145.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 14 MB/s | 4.9 MB 00:00 2024-09-22T03:01:39.501 INFO:teuthology.orchestra.run.smithi194.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 365 kB/s | 18 kB 00:00 2024-09-22T03:01:39.519 INFO:teuthology.orchestra.run.smithi145.stdout:(9/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.1 MB/s | 3.0 MB 00:00 2024-09-22T03:01:39.545 INFO:teuthology.orchestra.run.smithi145.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.7 MB/s | 250 kB 00:00 2024-09-22T03:01:39.568 INFO:teuthology.orchestra.run.smithi194.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 579 kB/s | 38 kB 00:00 2024-09-22T03:01:39.643 INFO:teuthology.orchestra.run.smithi194.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-09-22T03:01:39.693 INFO:teuthology.orchestra.run.smithi194.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-22T03:01:39.703 INFO:teuthology.orchestra.run.smithi145.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-09-22T03:01:39.810 INFO:teuthology.orchestra.run.smithi194.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 44 MB/s | 5.1 MB 00:00 2024-09-22T03:01:39.860 INFO:teuthology.orchestra.run.smithi194.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.9 MB/s | 250 kB 00:00 2024-09-22T03:01:39.928 INFO:teuthology.orchestra.run.smithi194.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 14 MB/s | 4.9 MB 00:00 2024-09-22T03:01:40.053 INFO:teuthology.orchestra.run.smithi194.stdout:(11/12): ceph-mgr-diskprediction-local-19.1.1-3 8.6 MB/s | 7.4 MB 00:00 2024-09-22T03:01:40.261 INFO:teuthology.orchestra.run.smithi194.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-09-22T03:01:40.262 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:40.263 INFO:teuthology.orchestra.run.smithi194.stdout:Total 33 MB/s | 38 MB 00:01 2024-09-22T03:01:40.570 INFO:teuthology.orchestra.run.smithi145.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-09-22T03:01:40.572 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:40.572 INFO:teuthology.orchestra.run.smithi145.stdout:Total 16 MB/s | 38 MB 00:02 2024-09-22T03:01:40.615 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:01:40.641 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:01:40.641 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:01:40.928 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:01:40.955 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:01:40.955 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:01:41.070 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:01:41.070 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:01:41.380 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:01:41.381 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:01:41.830 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:01:41.918 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-22T03:01:41.959 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:01:42.060 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:01:42.094 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-22T03:01:42.151 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:01:42.224 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-22T03:01:42.260 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:01:42.281 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-22T03:01:42.309 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-22T03:01:42.365 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:01:42.386 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-22T03:01:42.402 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-22T03:01:42.586 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-22T03:01:42.618 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-22T03:01:42.694 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-22T03:01:43.045 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-22T03:01:43.163 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-22T03:01:43.341 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-22T03:01:43.456 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-22T03:01:44.411 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:01:44.681 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:01:45.439 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-22T03:01:45.466 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-22T03:01:45.732 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-22T03:01:45.759 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-22T03:01:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-22T03:01:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-22T03:01:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:01:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:01:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-22T03:01:48.002 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-22T03:01:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-22T03:01:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-22T03:01:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-22T03:01:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-22T03:01:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:01:48.003 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-22T03:01:48.283 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-22T03:01:48.283 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-22T03:01:48.284 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-22T03:01:48.284 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-22T03:01:48.284 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-22T03:01:48.284 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-22T03:01:48.284 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-22T03:01:48.284 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-22T03:01:48.284 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-22T03:01:48.284 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-22T03:01:48.284 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-22T03:01:48.284 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-22T03:01:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-22T03:01:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:48.462 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:01:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:48.462 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T03:01:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T03:01:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T03:01:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T03:01:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T03:01:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T03:01:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T03:01:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T03:01:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T03:01:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T03:01:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T03:01:48.463 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:48.463 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:01:48.703 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-22T03:01:48.703 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:48.703 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:01:48.703 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:48.703 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-22T03:01:48.703 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-22T03:01:48.703 INFO:teuthology.orchestra.run.smithi145.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-22T03:01:48.703 INFO:teuthology.orchestra.run.smithi145.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-22T03:01:48.704 INFO:teuthology.orchestra.run.smithi145.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-22T03:01:48.704 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-22T03:01:48.704 INFO:teuthology.orchestra.run.smithi145.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-22T03:01:48.704 INFO:teuthology.orchestra.run.smithi145.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-22T03:01:48.704 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-22T03:01:48.704 INFO:teuthology.orchestra.run.smithi145.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-22T03:01:48.704 INFO:teuthology.orchestra.run.smithi145.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-22T03:01:48.704 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:48.704 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:01:48.824 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-rook 2024-09-22T03:01:49.065 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-mgr-rook 2024-09-22T03:01:49.410 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:09 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:49.542 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:01:49.544 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-22T03:01:49.544 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:49.544 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:01:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-22T03:01:49.544 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-22T03:01:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T03:01:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T03:01:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T03:01:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T03:01:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T03:01:49.544 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T03:01:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T03:01:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T03:01:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T03:01:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T03:01:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T03:01:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T03:01:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:49.545 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:01:49.545 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:49.545 INFO:teuthology.orchestra.run.smithi194.stdout:Install 13 Packages 2024-09-22T03:01:49.545 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:49.546 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 2.2 M 2024-09-22T03:01:49.546 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 26 M 2024-09-22T03:01:49.546 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:01:49.650 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:09 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:49.783 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:01:49.784 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:49.784 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-22T03:01:49.784 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:49.784 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:01:49.784 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-22T03:01:49.784 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:49.785 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:01:49.786 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:49.786 INFO:teuthology.orchestra.run.smithi145.stdout:Install 13 Packages 2024-09-22T03:01:49.786 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:49.787 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 2.2 M 2024-09-22T03:01:49.787 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 26 M 2024-09-22T03:01:49.787 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:01:50.048 INFO:teuthology.orchestra.run.smithi194.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 365 kB/s | 26 kB 00:00 2024-09-22T03:01:50.065 INFO:teuthology.orchestra.run.smithi194.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 220 kB/s | 19 kB 00:00 2024-09-22T03:01:50.140 INFO:teuthology.orchestra.run.smithi194.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.9 MB/s | 222 kB 00:00 2024-09-22T03:01:50.166 INFO:teuthology.orchestra.run.smithi194.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-22T03:01:50.182 INFO:teuthology.orchestra.run.smithi194.stdout:(5/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 241 kB/s | 49 kB 00:00 2024-09-22T03:01:50.199 INFO:teuthology.orchestra.run.smithi194.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.6 MB/s | 54 kB 00:00 2024-09-22T03:01:50.225 INFO:teuthology.orchestra.run.smithi194.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.2 MB/s | 279 kB 00:00 2024-09-22T03:01:50.266 INFO:teuthology.orchestra.run.smithi194.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 385 kB/s | 32 kB 00:00 2024-09-22T03:01:50.283 INFO:teuthology.orchestra.run.smithi194.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 169 kB/s | 14 kB 00:00 2024-09-22T03:01:50.308 INFO:teuthology.orchestra.run.smithi145.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 206 kB/s | 19 kB 00:00 2024-09-22T03:01:50.309 INFO:teuthology.orchestra.run.smithi194.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-22T03:01:50.333 INFO:teuthology.orchestra.run.smithi145.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 217 kB/s | 26 kB 00:00 2024-09-22T03:01:50.334 INFO:teuthology.orchestra.run.smithi194.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.2 MB/s | 220 kB 00:00 2024-09-22T03:01:50.359 INFO:teuthology.orchestra.run.smithi194.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-22T03:01:50.392 INFO:teuthology.orchestra.run.smithi145.stdout:(3/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 278 kB/s | 49 kB 00:00 2024-09-22T03:01:50.401 INFO:teuthology.orchestra.run.smithi194.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-22T03:01:50.404 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:50.404 INFO:teuthology.orchestra.run.smithi194.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-09-22T03:01:50.442 INFO:teuthology.orchestra.run.smithi145.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-09-22T03:01:50.467 INFO:teuthology.orchestra.run.smithi145.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-22T03:01:50.468 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:01:50.483 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:01:50.484 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:01:50.501 INFO:teuthology.orchestra.run.smithi145.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 915 kB/s | 54 kB 00:00 2024-09-22T03:01:50.535 INFO:teuthology.orchestra.run.smithi145.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 482 kB/s | 32 kB 00:00 2024-09-22T03:01:50.568 INFO:teuthology.orchestra.run.smithi145.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 216 kB/s | 14 kB 00:00 2024-09-22T03:01:50.573 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:01:50.573 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:01:50.602 INFO:teuthology.orchestra.run.smithi145.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 3.3 MB/s | 220 kB 00:00 2024-09-22T03:01:50.627 INFO:teuthology.orchestra.run.smithi145.stdout:(10/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.2 MB/s | 279 kB 00:00 2024-09-22T03:01:50.652 INFO:teuthology.orchestra.run.smithi145.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-22T03:01:50.703 INFO:teuthology.orchestra.run.smithi145.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.2 MB/s | 90 kB 00:00 2024-09-22T03:01:50.744 INFO:teuthology.orchestra.run.smithi145.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.8 MB/s | 1.0 MB 00:00 2024-09-22T03:01:50.747 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:50.747 INFO:teuthology.orchestra.run.smithi145.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-22T03:01:50.812 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:01:50.827 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:01:50.827 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:01:50.916 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:01:50.917 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:01:51.067 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:01:51.237 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-22T03:01:51.294 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-22T03:01:51.350 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-22T03:01:51.386 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-22T03:01:51.420 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:01:51.436 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-22T03:01:51.538 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-22T03:01:51.591 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-22T03:01:51.645 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-22T03:01:51.648 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-22T03:01:51.696 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-22T03:01:51.701 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-22T03:01:51.738 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-22T03:01:51.779 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-22T03:01:51.889 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-22T03:01:52.000 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-22T03:01:52.048 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-22T03:01:52.403 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-22T03:01:52.451 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-22T03:01:52.493 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-22T03:01:52.541 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-22T03:01:52.563 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-22T03:01:52.767 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-22T03:01:52.829 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-22T03:01:52.862 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-22T03:01:52.910 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-22T03:01:52.932 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-22T03:01:53.312 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-22T03:01:53.312 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-22T03:01:53.312 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-22T03:01:53.312 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-22T03:01:53.312 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-22T03:01:53.312 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-22T03:01:53.312 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-22T03:01:53.313 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-22T03:01:53.313 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-22T03:01:53.313 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-22T03:01:53.313 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-22T03:01:53.313 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-22T03:01:53.313 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-22T03:01:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-22T03:01:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:53.651 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:01:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T03:01:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T03:01:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T03:01:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T03:01:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T03:01:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T03:01:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T03:01:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T03:01:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T03:01:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T03:01:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T03:01:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T03:01:53.653 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:53.653 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:01:53.722 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-22T03:01:53.723 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-22T03:01:53.723 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-22T03:01:53.723 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-22T03:01:53.723 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-22T03:01:53.723 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-22T03:01:53.723 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-22T03:01:53.723 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-22T03:01:53.723 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-22T03:01:53.723 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-22T03:01:53.723 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-22T03:01:53.723 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-22T03:01:53.723 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-22T03:01:53.915 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-mgr-cephadm 2024-09-22T03:01:54.049 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-22T03:01:54.049 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:54.049 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:01:54.049 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:54.049 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-22T03:01:54.049 INFO:teuthology.orchestra.run.smithi145.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-22T03:01:54.049 INFO:teuthology.orchestra.run.smithi145.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-22T03:01:54.050 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-22T03:01:54.050 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-22T03:01:54.050 INFO:teuthology.orchestra.run.smithi145.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-22T03:01:54.050 INFO:teuthology.orchestra.run.smithi145.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-22T03:01:54.050 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-22T03:01:54.050 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-22T03:01:54.050 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-22T03:01:54.050 INFO:teuthology.orchestra.run.smithi145.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-22T03:01:54.050 INFO:teuthology.orchestra.run.smithi145.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-22T03:01:54.050 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:54.050 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:01:54.322 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-mgr-cephadm 2024-09-22T03:01:54.494 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:14 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:54.628 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:01:54.628 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:54.628 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-22T03:01:54.628 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:54.629 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:01:54.629 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-22T03:01:54.629 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-22T03:01:54.629 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T03:01:54.629 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T03:01:54.629 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T03:01:54.629 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T03:01:54.629 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T03:01:54.629 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:54.629 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:01:54.629 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:54.629 INFO:teuthology.orchestra.run.smithi194.stdout:Install 6 Packages 2024-09-22T03:01:54.629 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:54.630 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 7.0 M 2024-09-22T03:01:54.630 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 33 M 2024-09-22T03:01:54.630 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:01:54.917 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:14 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:55.062 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:01:55.063 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:55.063 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-22T03:01:55.063 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:55.063 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:01:55.063 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-22T03:01:55.063 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-22T03:01:55.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-22T03:01:55.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-22T03:01:55.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-22T03:01:55.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-22T03:01:55.063 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-22T03:01:55.063 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:55.064 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:01:55.064 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:01:55.064 INFO:teuthology.orchestra.run.smithi145.stdout:Install 6 Packages 2024-09-22T03:01:55.064 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:01:55.064 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 7.0 M 2024-09-22T03:01:55.064 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 33 M 2024-09-22T03:01:55.064 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:01:55.268 INFO:teuthology.orchestra.run.smithi194.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-22T03:01:55.318 INFO:teuthology.orchestra.run.smithi194.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-22T03:01:55.344 INFO:teuthology.orchestra.run.smithi194.stdout:(3/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 489 kB/s | 146 kB 00:00 2024-09-22T03:01:55.361 INFO:teuthology.orchestra.run.smithi194.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.3 MB/s | 58 kB 00:00 2024-09-22T03:01:55.403 INFO:teuthology.orchestra.run.smithi194.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-22T03:01:55.520 INFO:teuthology.orchestra.run.smithi194.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-22T03:01:55.522 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:55.522 INFO:teuthology.orchestra.run.smithi194.stdout:Total 7.9 MB/s | 7.0 MB 00:00 2024-09-22T03:01:55.580 INFO:teuthology.orchestra.run.smithi145.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-09-22T03:01:55.594 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:01:55.605 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:01:55.605 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:01:55.688 INFO:teuthology.orchestra.run.smithi145.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.9 MB/s | 548 kB 00:00 2024-09-22T03:01:55.705 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:01:55.705 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:01:55.713 INFO:teuthology.orchestra.run.smithi145.stdout:(3/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 407 kB/s | 146 kB 00:00 2024-09-22T03:01:55.739 INFO:teuthology.orchestra.run.smithi145.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-22T03:01:55.789 INFO:teuthology.orchestra.run.smithi145.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 989 kB/s | 74 kB 00:00 2024-09-22T03:01:56.023 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:01:56.193 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-22T03:01:56.238 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-22T03:01:56.760 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-22T03:01:56.840 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-22T03:01:56.903 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-22T03:01:56.925 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-22T03:01:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-22T03:01:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-22T03:01:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-22T03:01:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-22T03:01:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-22T03:01:57.719 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-22T03:01:57.956 INFO:teuthology.orchestra.run.smithi145.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.3 MB/s | 6.0 MB 00:02 2024-09-22T03:01:57.959 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:57.959 INFO:teuthology.orchestra.run.smithi145.stdout:Total 2.4 MB/s | 7.0 MB 00:02 2024-09-22T03:01:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-22T03:01:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:57.984 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:01:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:01:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T03:01:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T03:01:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T03:01:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T03:01:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T03:01:57.984 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:57.984 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:01:58.034 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:01:58.045 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:01:58.045 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:01:58.146 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:01:58.146 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:01:58.259 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-fuse 2024-09-22T03:01:58.456 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:01:58.629 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-22T03:01:58.683 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-22T03:01:58.856 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:18 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:01:59.001 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:01:59.001 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:59.001 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-22T03:01:59.001 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:59.001 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:01:59.001 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 868 k 2024-09-22T03:01:59.001 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-22T03:01:59.002 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T03:01:59.002 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:59.002 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:01:59.002 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:01:59.002 INFO:teuthology.orchestra.run.smithi194.stdout:Install 2 Packages 2024-09-22T03:01:59.002 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:01:59.002 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 948 k 2024-09-22T03:01:59.003 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 3.1 M 2024-09-22T03:01:59.003 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:01:59.218 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-22T03:01:59.311 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-22T03:01:59.375 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-22T03:01:59.403 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-22T03:01:59.538 INFO:teuthology.orchestra.run.smithi194.stdout:(1/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 3.3 MB/s | 868 kB 00:00 2024-09-22T03:01:59.654 INFO:teuthology.orchestra.run.smithi194.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 214 kB/s | 80 kB 00:00 2024-09-22T03:01:59.655 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:01:59.656 INFO:teuthology.orchestra.run.smithi194.stdout:Total 1.4 MB/s | 948 kB 00:00 2024-09-22T03:01:59.669 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:01:59.703 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:01:59.703 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:01:59.817 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:01:59.818 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:02:00.009 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:02:00.169 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-22T03:02:00.233 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-22T03:02:00.233 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-22T03:02:00.233 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-22T03:02:00.233 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-22T03:02:00.233 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-22T03:02:00.233 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-22T03:02:00.237 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-22T03:02:00.509 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-22T03:02:00.509 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:00.510 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:02:00.510 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:00.510 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-22T03:02:00.510 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-22T03:02:00.510 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-22T03:02:00.510 INFO:teuthology.orchestra.run.smithi145.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-22T03:02:00.510 INFO:teuthology.orchestra.run.smithi145.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-22T03:02:00.510 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:00.510 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:00.763 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-fuse 2024-09-22T03:02:00.998 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-22T03:02:00.998 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-22T03:02:01.283 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-22T03:02:01.283 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:01.283 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:02:01.283 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-22T03:02:01.283 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:01.283 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:01.347 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:21 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:01.483 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:01.483 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:01.483 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-22T03:02:01.484 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:01.484 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:02:01.484 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 868 k 2024-09-22T03:02:01.484 INFO:teuthology.orchestra.run.smithi145.stdout:Installing dependencies: 2024-09-22T03:02:01.484 INFO:teuthology.orchestra.run.smithi145.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-22T03:02:01.484 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:01.484 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:02:01.484 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:01.484 INFO:teuthology.orchestra.run.smithi145.stdout:Install 2 Packages 2024-09-22T03:02:01.484 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:01.485 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 948 k 2024-09-22T03:02:01.485 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 3.1 M 2024-09-22T03:02:01.485 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:02:01.584 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-volume 2024-09-22T03:02:01.757 INFO:teuthology.orchestra.run.smithi145.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 536 kB/s | 80 kB 00:00 2024-09-22T03:02:01.899 INFO:teuthology.orchestra.run.smithi145.stdout:(2/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 2.9 MB/s | 868 kB 00:00 2024-09-22T03:02:01.899 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:01.900 INFO:teuthology.orchestra.run.smithi145.stdout:Total 2.2 MB/s | 948 kB 00:00 2024-09-22T03:02:01.911 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:02:01.933 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:02:01.933 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:02:02.012 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:02:02.012 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:02:02.176 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:22 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:02.209 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:02:02.311 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:02:02.311 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:02.311 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-22T03:02:02.311 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:02.311 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:02:02.312 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 285 k 2024-09-22T03:02:02.312 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:02.312 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:02:02.312 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:02.312 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-22T03:02:02.312 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:02.312 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 285 k 2024-09-22T03:02:02.313 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 1.3 M 2024-09-22T03:02:02.313 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:02:02.335 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-22T03:02:02.415 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-22T03:02:02.525 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-volume-19.1.1-373.g4e45e6b4.el9.noarch.rpm 1.3 MB/s | 285 kB 00:00 2024-09-22T03:02:02.525 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:02.526 INFO:teuthology.orchestra.run.smithi194.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-22T03:02:02.526 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:02:02.535 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:02:02.535 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:02:02.566 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:02:02.566 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:02:02.790 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:02:02.869 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:02.884 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:02.884 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:02.884 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T03:02:02.884 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:03.092 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-22T03:02:03.093 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-22T03:02:03.377 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-22T03:02:03.377 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:03.377 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:02:03.377 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-22T03:02:03.377 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:03.378 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:03.695 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install ceph-volume 2024-09-22T03:02:03.907 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:03.907 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:03.907 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:02:03.908 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:03.908 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:03.908 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:04.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librados-devel 2024-09-22T03:02:04.288 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:24 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:04.427 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:04.427 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:04.427 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repository Size 2024-09-22T03:02:04.428 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:04.428 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:02:04.428 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 285 k 2024-09-22T03:02:04.428 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:04.428 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:02:04.428 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:04.428 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-22T03:02:04.428 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:04.429 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 285 k 2024-09-22T03:02:04.429 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 1.3 M 2024-09-22T03:02:04.429 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:02:04.646 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-volume-19.1.1-373.g4e45e6b4.el9.noarch.rpm 1.3 MB/s | 285 kB 00:00 2024-09-22T03:02:04.646 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:04.647 INFO:teuthology.orchestra.run.smithi145.stdout:Total 1.3 MB/s | 285 kB 00:00 2024-09-22T03:02:04.647 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:02:04.655 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:02:04.655 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:02:04.684 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:02:04.685 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:02:04.822 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:24 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:04.900 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:02:04.957 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:02:04.958 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2024-09-22T03:02:04.958 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:04.958 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:02:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-22T03:02:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:04.958 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:02:04.958 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:04.958 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-22T03:02:04.958 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:04.959 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 127 k 2024-09-22T03:02:04.959 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 457 k 2024-09-22T03:02:04.959 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:02:04.964 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:04.981 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:04.981 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:04.981 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-22T03:02:04.981 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:05.171 INFO:teuthology.orchestra.run.smithi194.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 599 kB/s | 127 kB 00:00 2024-09-22T03:02:05.171 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:05.172 INFO:teuthology.orchestra.run.smithi194.stdout:Total 595 kB/s | 127 kB 00:00 2024-09-22T03:02:05.172 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:02:05.178 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:02:05.178 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:02:05.241 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:02:05.242 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:02:05.390 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:02:05.477 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:05.930 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:06.051 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-22T03:02:06.051 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:06.051 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:02:06.051 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-volume-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-22T03:02:06.051 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:06.052 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:06.173 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:06.174 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:06.174 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:02:06.174 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:06.174 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:06.174 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:06.344 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install librados-devel 2024-09-22T03:02:06.424 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install libcephfs2 2024-09-22T03:02:06.936 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:26 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:07.028 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:27 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:07.073 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:07.073 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:07.073 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repo Size 2024-09-22T03:02:07.073 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:07.073 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:02:07.073 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-22T03:02:07.074 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:07.074 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:02:07.074 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:07.074 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-22T03:02:07.074 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:07.074 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 127 k 2024-09-22T03:02:07.074 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 457 k 2024-09-22T03:02:07.075 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:02:07.120 INFO:teuthology.orchestra.run.smithi194.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:07.166 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:02:07.167 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-22T03:02:07.167 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:07.237 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install libcephfs-devel 2024-09-22T03:02:07.276 INFO:teuthology.orchestra.run.smithi145.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 629 kB/s | 127 kB 00:00 2024-09-22T03:02:07.277 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:07.277 INFO:teuthology.orchestra.run.smithi145.stdout:Total 624 kB/s | 127 kB 00:00 2024-09-22T03:02:07.277 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:02:07.283 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:02:07.283 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:02:07.345 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:02:07.346 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:02:07.498 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:02:07.607 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:07.820 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:27 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:07.953 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:02:07.953 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:07.954 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2024-09-22T03:02:07.954 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:07.954 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:02:07.954 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-22T03:02:07.954 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:07.954 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:02:07.954 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:07.954 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-22T03:02:07.954 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:07.954 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 32 k 2024-09-22T03:02:07.954 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 142 k 2024-09-22T03:02:07.954 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:02:08.110 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:08.115 INFO:teuthology.orchestra.run.smithi194.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 197 kB/s | 32 kB 00:00 2024-09-22T03:02:08.115 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:08.116 INFO:teuthology.orchestra.run.smithi194.stdout:Total 196 kB/s | 32 kB 00:00 2024-09-22T03:02:08.116 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:02:08.119 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:02:08.119 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:02:08.137 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:02:08.137 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:02:08.230 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:02:08.337 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:08.367 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:08.367 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:08.367 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:02:08.367 INFO:teuthology.orchestra.run.smithi145.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:08.367 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:08.367 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:08.635 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install libcephfs2 2024-09-22T03:02:08.695 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:08.922 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:08.922 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:08.922 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:02:08.922 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:08.923 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:08.923 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:09.112 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librados2 2024-09-22T03:02:09.237 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:29 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:09.329 INFO:teuthology.orchestra.run.smithi145.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:09.375 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:09.376 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-22T03:02:09.376 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:09.444 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install libcephfs-devel 2024-09-22T03:02:09.698 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:29 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:09.789 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:09.833 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:02:09.834 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-22T03:02:09.834 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:09.913 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install librbd1 2024-09-22T03:02:10.024 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:30 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:10.157 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:10.158 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:10.158 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repo Size 2024-09-22T03:02:10.158 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:10.158 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:02:10.158 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-22T03:02:10.158 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:10.158 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:02:10.158 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:10.158 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-22T03:02:10.158 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:10.158 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 32 k 2024-09-22T03:02:10.159 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 142 k 2024-09-22T03:02:10.159 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:02:10.313 INFO:teuthology.orchestra.run.smithi145.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 205 kB/s | 32 kB 00:00 2024-09-22T03:02:10.314 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:10.314 INFO:teuthology.orchestra.run.smithi145.stdout:Total 203 kB/s | 32 kB 00:00 2024-09-22T03:02:10.314 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:02:10.318 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:02:10.318 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:02:10.340 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:02:10.341 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:02:10.430 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:02:10.494 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:30 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:10.545 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:10.585 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:10.630 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:02:10.630 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-22T03:02:10.631 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:10.699 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rados 2024-09-22T03:02:10.914 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:11.148 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:11.148 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:11.148 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:02:11.148 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:11.148 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:11.148 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:11.279 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:31 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:11.336 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install librados2 2024-09-22T03:02:11.368 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:11.412 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:02:11.413 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-22T03:02:11.413 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:11.487 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rgw 2024-09-22T03:02:11.914 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:31 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:12.005 INFO:teuthology.orchestra.run.smithi145.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:12.049 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:12.050 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-22T03:02:12.050 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:12.065 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:32 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:12.120 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install librbd1 2024-09-22T03:02:12.156 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:12.200 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:02:12.201 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-22T03:02:12.201 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:12.277 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-cephfs 2024-09-22T03:02:12.705 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:32 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:12.795 INFO:teuthology.orchestra.run.smithi145.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:12.839 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:12.840 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-22T03:02:12.840 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:12.859 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:32 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:12.903 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install python3-rados 2024-09-22T03:02:12.949 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:12.992 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:02:12.993 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-22T03:02:12.993 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:13.068 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install python3-rbd 2024-09-22T03:02:13.480 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:33 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:13.569 INFO:teuthology.orchestra.run.smithi145.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:13.613 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:13.614 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-22T03:02:13.614 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:13.644 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:33 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:13.678 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install python3-rgw 2024-09-22T03:02:13.735 INFO:teuthology.orchestra.run.smithi194.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:13.779 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:02:13.780 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-22T03:02:13.780 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:13.851 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-fuse 2024-09-22T03:02:14.257 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:34 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:14.346 INFO:teuthology.orchestra.run.smithi145.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:14.390 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:14.391 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-22T03:02:14.391 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:14.436 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:34 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:14.465 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install python3-cephfs 2024-09-22T03:02:14.570 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:02:14.570 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:14.570 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-09-22T03:02:14.570 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:14.570 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:02:14.571 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-22T03:02:14.571 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:14.571 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:02:14.571 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:14.571 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-22T03:02:14.571 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:14.571 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 85 k 2024-09-22T03:02:14.572 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 256 k 2024-09-22T03:02:14.572 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:02:14.768 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 434 kB/s | 85 kB 00:00 2024-09-22T03:02:14.769 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:14.769 INFO:teuthology.orchestra.run.smithi194.stdout:Total 431 kB/s | 85 kB 00:00 2024-09-22T03:02:14.769 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:02:14.776 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:02:14.776 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:02:14.841 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:02:14.842 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:02:14.987 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:02:15.040 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:35 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:15.083 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:15.128 INFO:teuthology.orchestra.run.smithi145.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:15.171 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:15.172 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-22T03:02:15.172 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:15.236 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install python3-rbd 2024-09-22T03:02:15.515 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:15.773 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:02:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:15.773 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:15.773 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:15.816 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:35 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:15.906 INFO:teuthology.orchestra.run.smithi145.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-22T03:02:15.949 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:15.950 INFO:teuthology.orchestra.run.smithi145.stdout:Nothing to do. 2024-09-22T03:02:15.950 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:16.028 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install rbd-fuse 2024-09-22T03:02:16.057 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-mirror 2024-09-22T03:02:16.609 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:36 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:16.650 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:36 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:16.744 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:16.745 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-09-22T03:02:16.745 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:16.745 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:02:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-22T03:02:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:16.745 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:02:16.746 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:16.746 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-22T03:02:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:16.746 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 85 k 2024-09-22T03:02:16.746 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 256 k 2024-09-22T03:02:16.746 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:02:16.788 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:02:16.789 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repo Size 2024-09-22T03:02:16.790 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:16.790 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:02:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-22T03:02:16.790 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:16.790 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:02:16.791 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:16.791 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-22T03:02:16.791 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:16.791 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 3.1 M 2024-09-22T03:02:16.791 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 14 M 2024-09-22T03:02:16.791 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:02:16.951 INFO:teuthology.orchestra.run.smithi145.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 419 kB/s | 85 kB 00:00 2024-09-22T03:02:16.951 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:16.952 INFO:teuthology.orchestra.run.smithi145.stdout:Total 416 kB/s | 85 kB 00:00 2024-09-22T03:02:16.952 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:02:16.958 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:02:16.958 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:02:17.022 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:02:17.022 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:02:17.113 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.5 MB/s | 3.1 MB 00:00 2024-09-22T03:02:17.113 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:17.114 INFO:teuthology.orchestra.run.smithi194.stdout:Total 9.4 MB/s | 3.1 MB 00:00 2024-09-22T03:02:17.114 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:02:17.122 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:02:17.123 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:02:17.166 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:02:17.204 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:02:17.205 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:02:17.264 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:17.650 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:02:17.675 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:17.705 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:17.730 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:17.730 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:17.730 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T03:02:17.730 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:02:17.730 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:02:17.730 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:17.933 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:17.933 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:17.933 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:02:17.933 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:17.934 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:17.934 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:18.231 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install rbd-mirror 2024-09-22T03:02:18.804 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:18.804 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:18.805 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:02:18.805 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:18.805 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:18.805 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:18.833 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:38 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:18.971 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:18.972 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:18.972 INFO:teuthology.orchestra.run.smithi145.stdout: Package Arch Version Repo Size 2024-09-22T03:02:18.972 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:18.972 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:02:18.972 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-22T03:02:18.972 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:02:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-22T03:02:18.973 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 3.1 M 2024-09-22T03:02:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 14 M 2024-09-22T03:02:18.973 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:02:19.070 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install rbd-nbd 2024-09-22T03:02:19.320 INFO:teuthology.orchestra.run.smithi145.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 8.8 MB/s | 3.1 MB 00:00 2024-09-22T03:02:19.321 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:19.321 INFO:teuthology.orchestra.run.smithi145.stdout:Total 8.8 MB/s | 3.1 MB 00:00 2024-09-22T03:02:19.321 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:02:19.330 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:02:19.330 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:02:19.410 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:02:19.411 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:02:19.659 INFO:teuthology.orchestra.run.smithi194.stdout:Last metadata expiration check: 0:02:39 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:19.797 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-22T03:02:19.797 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:19.797 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-09-22T03:02:19.797 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:19.797 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-22T03:02:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 169 k 2024-09-22T03:02:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:19.798 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-22T03:02:19.798 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-09-22T03:02:19.798 INFO:teuthology.orchestra.run.smithi194.stdout:Install 1 Package 2024-09-22T03:02:19.798 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:19.798 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 169 k 2024-09-22T03:02:19.799 INFO:teuthology.orchestra.run.smithi194.stdout:Installed size: 540 k 2024-09-22T03:02:19.799 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-22T03:02:19.855 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:02:19.921 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:19.946 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:19.946 INFO:teuthology.orchestra.run.smithi145.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-22T03:02:19.946 INFO:teuthology.orchestra.run.smithi145.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-22T03:02:19.946 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:02:19.947 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-22T03:02:19.947 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:20.024 INFO:teuthology.orchestra.run.smithi194.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 753 kB/s | 169 kB 00:00 2024-09-22T03:02:20.025 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:20.025 INFO:teuthology.orchestra.run.smithi194.stdout:Total 748 kB/s | 169 kB 00:00 2024-09-22T03:02:20.025 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-22T03:02:20.033 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-22T03:02:20.033 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-22T03:02:20.098 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-22T03:02:20.099 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-22T03:02:20.251 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-22T03:02:20.346 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:20.825 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:21.063 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:21.063 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:21.063 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-22T03:02:21.063 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:21.063 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:21.063 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-22T03:02:21.095 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:21.095 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:21.095 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:02:21.095 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:21.095 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:21.096 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:21.320 DEBUG:teuthology.parallel:result is None 2024-09-22T03:02:21.324 DEBUG:teuthology.orchestra.run.smithi145:> sudo yum -y install rbd-nbd 2024-09-22T03:02:21.923 INFO:teuthology.orchestra.run.smithi145.stdout:Last metadata expiration check: 0:02:41 ago on Sun 22 Sep 2024 02:59:40 AM UTC. 2024-09-22T03:02:22.061 INFO:teuthology.orchestra.run.smithi145.stdout:Dependencies resolved. 2024-09-22T03:02:22.062 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: Package Architecture Version Repository Size 2024-09-22T03:02:22.062 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:22.062 INFO:teuthology.orchestra.run.smithi145.stdout:Installing: 2024-09-22T03:02:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 169 k 2024-09-22T03:02:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:22.063 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction Summary 2024-09-22T03:02:22.063 INFO:teuthology.orchestra.run.smithi145.stdout:================================================================================ 2024-09-22T03:02:22.063 INFO:teuthology.orchestra.run.smithi145.stdout:Install 1 Package 2024-09-22T03:02:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:22.063 INFO:teuthology.orchestra.run.smithi145.stdout:Total download size: 169 k 2024-09-22T03:02:22.063 INFO:teuthology.orchestra.run.smithi145.stdout:Installed size: 540 k 2024-09-22T03:02:22.063 INFO:teuthology.orchestra.run.smithi145.stdout:Downloading Packages: 2024-09-22T03:02:22.273 INFO:teuthology.orchestra.run.smithi145.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 806 kB/s | 169 kB 00:00 2024-09-22T03:02:22.274 INFO:teuthology.orchestra.run.smithi145.stdout:-------------------------------------------------------------------------------- 2024-09-22T03:02:22.274 INFO:teuthology.orchestra.run.smithi145.stdout:Total 801 kB/s | 169 kB 00:00 2024-09-22T03:02:22.274 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction check 2024-09-22T03:02:22.282 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction check succeeded. 2024-09-22T03:02:22.282 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction test 2024-09-22T03:02:22.348 INFO:teuthology.orchestra.run.smithi145.stdout:Transaction test succeeded. 2024-09-22T03:02:22.348 INFO:teuthology.orchestra.run.smithi145.stdout:Running transaction 2024-09-22T03:02:22.502 INFO:teuthology.orchestra.run.smithi145.stdout: Preparing : 1/1 2024-09-22T03:02:22.604 INFO:teuthology.orchestra.run.smithi145.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:23.055 INFO:teuthology.orchestra.run.smithi145.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:23.331 INFO:teuthology.orchestra.run.smithi145.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-22T03:02:23.331 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:23.331 INFO:teuthology.orchestra.run.smithi145.stdout:Installed: 2024-09-22T03:02:23.332 INFO:teuthology.orchestra.run.smithi145.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-22T03:02:23.332 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:23.332 INFO:teuthology.orchestra.run.smithi145.stdout:Complete! 2024-09-22T03:02:23.559 DEBUG:teuthology.parallel:result is None 2024-09-22T03:02:23.559 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T03:02:23.701 DEBUG:teuthology.orchestra.run.smithi145:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T03:02:23.723 INFO:teuthology.orchestra.run.smithi145.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-22T03:02:23.724 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-22T03:02:23.724 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-22T03:02:23.725 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=4e45e6b490e6cbe082cdf155fea780438ec53fc7 2024-09-22T03:02:23.869 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-22T03:02:23.895 INFO:teuthology.orchestra.run.smithi194.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-22T03:02:23.895 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-22T03:02:23.895 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-22T03:02:23.897 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-22T03:02:23.897 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:23.897 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T03:02:23.924 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T03:02:23.924 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-22T03:02:23.965 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-22T03:02:23.965 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:23.965 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T03:02:23.991 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T03:02:24.057 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T03:02:24.058 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-09-22T03:02:24.086 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-22T03:02:24.154 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-22T03:02:24.155 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:24.155 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T03:02:24.181 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T03:02:24.265 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T03:02:24.265 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-22T03:02:24.293 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-22T03:02:24.360 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-22T03:02:24.361 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:24.361 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T03:02:24.387 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T03:02:24.453 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T03:02:24.453 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-09-22T03:02:24.479 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-22T03:02:24.544 INFO:teuthology.run_tasks:Running task ceph... 2024-09-22T03:02:24.612 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-22T03:02:24.612 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /var/log/ceph 2024-09-22T03:02:24.615 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2024-09-22T03:02:24.640 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-22T03:02:24.641 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T03:02:24.680 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-22T03:02:24.706 INFO:tasks.ceph:Creating extra log directories... 2024-09-22T03:02:24.706 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T03:02:24.744 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-22T03:02:24.780 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-22T03:02:24.780 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-22T03:02:24.780 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914713', 'branch': 'squid', 'description': 'crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/admin_socket_objecter_requests}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7914713', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi', 'no_nested_subset': False, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'squid', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1158, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'crimson-rados', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_4e45e6b490e6cbe082cdf155fea780438ec53fc7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'targets': {'smithi145.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAKpPWUzSrkvjh+ivSi7o2EgjRDXKsjJPOIEAhLWrlG4Wl79AWlOdV+H8R4vKxqyyw0zlifNyJ+Crg9ay4s5ag=', 'smithi194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEyDjLLeE9EbMW0jsR+8AdpIMpxLDAtKHA1sawq/DMZ3pAh8qcjHqkztVbZiDrbGMYtjeoGhjxFi3fW8FPvpNw8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7', 'cluster': 'ceph'}}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400}}, {'radosbench': {'clients': ['client.0'], 'time': 150}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-21_21:56:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2902'} 2024-09-22T03:02:24.781 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T03:02:24.810 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-22T03:02:24.827 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T03:02:24.864 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2024-09-22T03:02:24.892 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:24.892 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T03:02:24.943 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T03:02:24.943 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2024-09-22T03:02:24.998 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T03:02:24.998 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:02:24.998 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-22T03:02:24.999 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:02:24.999 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:02:24.999 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-22 03:02:20.202900611 +0000 2024-09-22T03:02:24.999 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-22 02:59:04.052328180 +0000 2024-09-22T03:02:24.999 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-22 02:59:04.052328180 +0000 2024-09-22T03:02:24.999 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-22 02:59:04.052328180 +0000 2024-09-22T03:02:24.999 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T03:02:25.062 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-22T03:02:25.062 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-22T03:02:25.062 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.00025394 s, 2.0 MB/s 2024-09-22T03:02:25.063 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T03:02:25.119 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2024-09-22T03:02:25.174 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T03:02:25.174 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:02:25.174 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-22T03:02:25.174 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:02:25.174 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:02:25.174 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-22 03:02:20.202900611 +0000 2024-09-22T03:02:25.174 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-22 02:59:04.373321264 +0000 2024-09-22T03:02:25.174 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-22 02:59:04.373321264 +0000 2024-09-22T03:02:25.175 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-22 02:59:04.373321264 +0000 2024-09-22T03:02:25.175 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T03:02:25.237 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-22T03:02:25.237 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-22T03:02:25.237 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000194408 s, 2.6 MB/s 2024-09-22T03:02:25.238 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T03:02:25.294 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2024-09-22T03:02:25.350 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T03:02:25.350 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:02:25.350 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-22T03:02:25.350 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:02:25.350 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:02:25.350 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-22 03:02:20.203900590 +0000 2024-09-22T03:02:25.350 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-22 02:59:04.714313917 +0000 2024-09-22T03:02:25.350 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-22 02:59:04.714313917 +0000 2024-09-22T03:02:25.350 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-22 02:59:04.714313917 +0000 2024-09-22T03:02:25.351 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T03:02:25.413 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-22T03:02:25.413 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-22T03:02:25.413 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000227503 s, 2.3 MB/s 2024-09-22T03:02:25.414 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T03:02:25.470 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2024-09-22T03:02:25.525 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T03:02:25.526 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:02:25.526 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-22T03:02:25.526 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:02:25.526 INFO:teuthology.orchestra.run.smithi145.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:02:25.526 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-22 03:02:20.203900590 +0000 2024-09-22T03:02:25.526 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-22 02:59:05.031307087 +0000 2024-09-22T03:02:25.526 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-22 02:59:05.031307087 +0000 2024-09-22T03:02:25.526 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: 2024-09-22 02:59:05.031307087 +0000 2024-09-22T03:02:25.526 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T03:02:25.588 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-22T03:02:25.588 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-22T03:02:25.588 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000172369 s, 3.0 MB/s 2024-09-22T03:02:25.590 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T03:02:25.645 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-22T03:02:25.645 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T03:02:25.645 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-09-22T03:02:25.662 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-22T03:02:25.662 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-09-22T03:02:25.719 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-22T03:02:25.719 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:02:25.719 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-22T03:02:25.719 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:02:25.719 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:02:25.719 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-22 03:02:17.979978494 +0000 2024-09-22T03:02:25.720 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-22 02:58:57.311494896 +0000 2024-09-22T03:02:25.720 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-22 02:58:57.311494896 +0000 2024-09-22T03:02:25.720 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-22 02:58:57.311494896 +0000 2024-09-22T03:02:25.720 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-22T03:02:25.784 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-22T03:02:25.784 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-22T03:02:25.784 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000206624 s, 2.5 MB/s 2024-09-22T03:02:25.785 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-22T03:02:25.842 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-09-22T03:02:25.898 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-22T03:02:25.898 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:02:25.898 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-22T03:02:25.898 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:02:25.898 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:02:25.898 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-22 03:02:17.979978494 +0000 2024-09-22T03:02:25.898 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-22 02:58:57.634493692 +0000 2024-09-22T03:02:25.899 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-22 02:58:57.634493692 +0000 2024-09-22T03:02:25.899 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-22 02:58:57.634493692 +0000 2024-09-22T03:02:25.899 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-22T03:02:25.962 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-22T03:02:25.962 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-22T03:02:25.962 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000208384 s, 2.5 MB/s 2024-09-22T03:02:25.963 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-22T03:02:26.020 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-09-22T03:02:26.075 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-22T03:02:26.075 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:02:26.075 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-22T03:02:26.075 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:02:26.075 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:02:26.075 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-22 03:02:17.980978492 +0000 2024-09-22T03:02:26.075 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-22 02:58:57.966492454 +0000 2024-09-22T03:02:26.075 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-22 02:58:57.966492454 +0000 2024-09-22T03:02:26.076 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-22 02:58:57.966492454 +0000 2024-09-22T03:02:26.076 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-22T03:02:26.138 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-22T03:02:26.138 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-22T03:02:26.138 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000176224 s, 2.9 MB/s 2024-09-22T03:02:26.140 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-22T03:02:26.195 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-09-22T03:02:26.251 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-22T03:02:26.251 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-22T03:02:26.251 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-22T03:02:26.251 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-22T03:02:26.251 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-22T03:02:26.251 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-22 03:02:17.980978492 +0000 2024-09-22T03:02:26.251 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-22 02:58:58.278491291 +0000 2024-09-22T03:02:26.251 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-22 02:58:58.278491291 +0000 2024-09-22T03:02:26.251 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-22 02:58:58.278491291 +0000 2024-09-22T03:02:26.252 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-22T03:02:26.315 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-22T03:02:26.315 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-22T03:02:26.315 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.00030301 s, 1.7 MB/s 2024-09-22T03:02:26.316 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-22T03:02:26.373 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-22T03:02:26.373 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-22T03:02:26.373 INFO:tasks.ceph:Generating config... 2024-09-22T03:02:26.374 INFO:tasks.ceph:[osd] debug monc = 20 2024-09-22T03:02:26.374 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-22T03:02:26.374 INFO:tasks.ceph:[osd] bluestore compression algorithm = snappy 2024-09-22T03:02:26.374 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-22T03:02:26.374 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] bluestore rocksdb cf = False 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] err to stderr = True 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] log flush on exit = True 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] log to file = False 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] log to stderr = True 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-22T03:02:26.375 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-22T03:02:26.376 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-22T03:02:26.376 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-22T03:02:26.376 INFO:tasks.ceph:[osd] osd debug reject backfill probability = 0.3 2024-09-22T03:02:26.376 INFO:tasks.ceph:[osd] osd delete sleep = 1 2024-09-22T03:02:26.376 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-22T03:02:26.376 INFO:tasks.ceph:[osd] osd max backfills = 3 2024-09-22T03:02:26.376 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-22T03:02:26.376 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-22T03:02:26.376 INFO:tasks.ceph:[osd] osd scrub max interval = 120 2024-09-22T03:02:26.376 INFO:tasks.ceph:[osd] osd scrub min interval = 60 2024-09-22T03:02:26.376 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-22T03:02:26.376 INFO:tasks.ceph:[osd] osd snap trim sleep = 2 2024-09-22T03:02:26.376 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-09-22T03:02:26.376 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-09-22T03:02:26.376 INFO:tasks.ceph:[global] ms client mode = crc 2024-09-22T03:02:26.377 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-09-22T03:02:26.377 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-09-22T03:02:26.377 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-09-22T03:02:26.377 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-09-22T03:02:26.377 INFO:tasks.ceph:[global] ms service mode = crc 2024-09-22T03:02:26.377 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2024-09-22T03:02:26.377 INFO:tasks.ceph:[global] osd_pool_default_size = 3 2024-09-22T03:02:26.377 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-22T03:02:26.377 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-22T03:02:26.377 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-22T03:02:26.377 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-22T03:02:26.377 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-22T03:02:26.377 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-09-22T03:02:26.377 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-22T03:02:26.377 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-22T03:02:26.378 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-22T03:02:26.378 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-09-22T03:02:26.378 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-09-22T03:02:26.378 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-09-22T03:02:26.378 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-09-22T03:02:26.378 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-09-22T03:02:26.378 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-09-22T03:02:26.378 INFO:tasks.ceph:Setting up mon.a... 2024-09-22T03:02:26.378 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-22T03:02:26.439 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.keyring 2024-09-22T03:02:26.442 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-22T03:02:26.492 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T03:02:26.517 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.145')] 2024-09-22T03:02:26.517 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.145', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': 120, 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-09-22T03:02:26.518 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:26.518 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T03:02:26.573 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.145 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:02:26.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:02:26.658+0000 7f133d49ee80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:26.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:02:26.658+0000 7f133d49ee80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:26.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:02:26.658+0000 7f133d49ee80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:26.661 INFO:teuthology.orchestra.run.smithi145.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:02:26.661 INFO:teuthology.orchestra.run.smithi145.stdout:monmaptool: generated fsid 110716e9-1590-4d11-aa79-697b4ec9a4b0 2024-09-22T03:02:26.661 INFO:teuthology.orchestra.run.smithi145.stdout:setting min_mon_release = quincy 2024-09-22T03:02:26.661 INFO:teuthology.orchestra.run.smithi145.stdout:epoch 0 2024-09-22T03:02:26.661 INFO:teuthology.orchestra.run.smithi145.stdout:fsid 110716e9-1590-4d11-aa79-697b4ec9a4b0 2024-09-22T03:02:26.661 INFO:teuthology.orchestra.run.smithi145.stdout:last_changed 2024-09-22T03:02:26.659869+0000 2024-09-22T03:02:26.661 INFO:teuthology.orchestra.run.smithi145.stdout:created 2024-09-22T03:02:26.659869+0000 2024-09-22T03:02:26.661 INFO:teuthology.orchestra.run.smithi145.stdout:min_mon_release 17 (quincy) 2024-09-22T03:02:26.661 INFO:teuthology.orchestra.run.smithi145.stdout:election_strategy: 1 2024-09-22T03:02:26.661 INFO:teuthology.orchestra.run.smithi145.stdout:0: [v2:172.21.15.145:3300/0,v1:172.21.15.145:6789/0] mon.a 2024-09-22T03:02:26.662 INFO:teuthology.orchestra.run.smithi145.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-22T03:02:26.663 DEBUG:teuthology.orchestra.run.smithi145:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-22T03:02:26.677 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 110716e9-1590-4d11-aa79-697b4ec9a4b0... 2024-09-22T03:02:26.678 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T03:02:26.720 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-22T03:02:26.759 INFO:teuthology.orchestra.run.smithi145.stdout:[global] 2024-09-22T03:02:26.760 INFO:teuthology.orchestra.run.smithi145.stdout: chdir = "" 2024-09-22T03:02:26.760 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T03:02:26.760 INFO:teuthology.orchestra.run.smithi145.stdout: auth supported = cephx 2024-09-22T03:02:26.760 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.760 INFO:teuthology.orchestra.run.smithi145.stdout: filestore xattr use omap = true 2024-09-22T03:02:26.760 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.760 INFO:teuthology.orchestra.run.smithi145.stdout: mon clock drift allowed = 1.000 2024-09-22T03:02:26.760 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.760 INFO:teuthology.orchestra.run.smithi145.stdout: osd crush chooseleaf type = 0 2024-09-22T03:02:26.760 INFO:teuthology.orchestra.run.smithi145.stdout: auth debug = true 2024-09-22T03:02:26.760 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.760 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on old message = true 2024-09-22T03:02:26.760 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on bug = true 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: mon pg warn max object skew = 0 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default size = 2 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow primary affinity = true 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow pg remap = true 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on legacy crush tunables = false 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on crush straw calc version zero = false 2024-09-22T03:02:26.761 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on no sortbitwise = false 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on osd down out interval zero = false 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on too few osds = false 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: mon_allow_pool_size_one = true 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: osd default data pool replay window = 5 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: mon allow pool delete = true 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: mon cluster log file level = debug 2024-09-22T03:02:26.762 INFO:teuthology.orchestra.run.smithi145.stdout: debug asserts on shutdown = true 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: mon health detail to clog = false 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: mon host = 172.21.15.145 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: ms client mode = crc 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: ms cluster mode = crc 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: ms mon client mode = crc 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: ms mon cluster mode = crc 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: ms mon service mode = crc 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: ms service mode = crc 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: osd_pool_default_min_size = 2 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: osd_pool_default_size = 3 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: fsid = 110716e9-1590-4d11-aa79-697b4ec9a4b0 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout:[osd] 2024-09-22T03:02:26.763 INFO:teuthology.orchestra.run.smithi145.stdout: osd journal size = 100 2024-09-22T03:02:26.764 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.764 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub load threshold = 5.0 2024-09-22T03:02:26.764 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub max interval = 120 2024-09-22T03:02:26.764 INFO:teuthology.orchestra.run.smithi145.stdout: osd mclock profile = high_recovery_ops 2024-09-22T03:02:26.764 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.764 INFO:teuthology.orchestra.run.smithi145.stdout: osd recover clone overlap = true 2024-09-22T03:02:26.764 INFO:teuthology.orchestra.run.smithi145.stdout: osd recovery max chunk = 1048576 2024-09-22T03:02:26.765 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.765 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug shutdown = true 2024-09-22T03:02:26.765 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug op order = true 2024-09-22T03:02:26.765 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug verify stray on activate = true 2024-09-22T03:02:26.765 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug trim objects = true 2024-09-22T03:02:26.765 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.765 INFO:teuthology.orchestra.run.smithi145.stdout: osd open classes on start = true 2024-09-22T03:02:26.765 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug pg log writeout = true 2024-09-22T03:02:26.765 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.765 INFO:teuthology.orchestra.run.smithi145.stdout: osd deep scrub update digest min age = 30 2024-09-22T03:02:26.765 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.765 INFO:teuthology.orchestra.run.smithi145.stdout: osd map max advance = 10 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: journal zero on create = true 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: filestore ondisk finisher threads = 3 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: filestore apply finisher threads = 3 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: bdev debug aio = true 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug misdirected ops = true 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: debug monc = 20 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore block size = 96636764160 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore compression algorithm = snappy 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore compression mode = aggressive 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore fsck on mount = True 2024-09-22T03:02:26.766 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore rocksdb cf = False 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: crimson alien thread cpu cores = 6-7 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: crimson osd obc lru size = 10 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluefs = 20 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluestore = 20 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: debug osd = 20 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: debug rocksdb = 10 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: err to stderr = True 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: log flush on exit = True 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: log to file = False 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: log to stderr = True 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd full ratio = 0.9 2024-09-22T03:02:26.767 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd nearfull ratio = 0.8 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: osd blocked scrub grace period = 3600 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug reject backfill probability = 0.3 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: osd delete sleep = 1 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: osd failsafe full ratio = 0.95 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: osd max backfills = 3 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: osd max markdown count = 1000 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: osd objectstore = bluestore 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub min interval = 60 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: osd shutdown pgref assert = True 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: osd snap trim sleep = 2 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr] 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: debug mgr = 20 2024-09-22T03:02:26.768 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout: mgr/telemetry/nag = false 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout:[mon] 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout: debug paxos = 20 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon data avail warn = 5 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon mgr mkfs grace = 240 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:02:26.769 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd reporter subtree level = osd 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd prime pg temp = true 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: # 1m isn't quite enough 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: mon_down_mkfs_grace = 2m 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.770 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_filestore_osds = false 2024-09-22T03:02:26.771 INFO:teuthology.orchestra.run.smithi145.stdout: mon min osdmap epochs = 50 2024-09-22T03:02:26.771 INFO:teuthology.orchestra.run.smithi145.stdout: mon osdmap full prune interval = 2 2024-09-22T03:02:26.771 INFO:teuthology.orchestra.run.smithi145.stdout: mon osdmap full prune min = 15 2024-09-22T03:02:26.771 INFO:teuthology.orchestra.run.smithi145.stdout: mon osdmap full prune txsize = 2 2024-09-22T03:02:26.771 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default crimson = True 2024-09-22T03:02:26.771 INFO:teuthology.orchestra.run.smithi145.stdout: paxos service trim min = 10 2024-09-22T03:02:26.771 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:26.771 INFO:teuthology.orchestra.run.smithi145.stdout:[client] 2024-09-22T03:02:26.771 INFO:teuthology.orchestra.run.smithi145.stdout: rgw cache enabled = true 2024-09-22T03:02:26.771 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable ops log = true 2024-09-22T03:02:26.771 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable usage log = true 2024-09-22T03:02:26.771 INFO:teuthology.orchestra.run.smithi145.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T03:02:26.771 INFO:teuthology.orchestra.run.smithi145.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T03:02:26.772 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.a] 2024-09-22T03:02:26.772 INFO:teuthology.orchestra.run.smithi145.stdout:[client.0] 2024-09-22T03:02:26.772 INFO:teuthology.orchestra.run.smithi145.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-22T03:02:26.772 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.0] 2024-09-22T03:02:26.772 INFO:teuthology.orchestra.run.smithi145.stdout: crimson seastar cpu cores = 0-2 2024-09-22T03:02:26.772 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.1] 2024-09-22T03:02:26.772 INFO:teuthology.orchestra.run.smithi145.stdout: crimson seastar cpu cores = 3-5 2024-09-22T03:02:26.772 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.2] 2024-09-22T03:02:26.772 INFO:teuthology.orchestra.run.smithi145.stdout: crimson seastar cpu cores = 0-2 2024-09-22T03:02:26.772 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.3] 2024-09-22T03:02:26.772 INFO:teuthology.orchestra.run.smithi145.stdout: crimson seastar cpu cores = 3-5 2024-09-22T03:02:26.773 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2024-09-22T03:02:26.773 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2024-09-22T03:02:26.773 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-22T03:02:26.773 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2024-09-22T03:02:26.773 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.773 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2024-09-22T03:02:26.773 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.773 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2024-09-22T03:02:26.773 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.773 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.774 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2024-09-22T03:02:26.775 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2024-09-22T03:02:26.775 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2024-09-22T03:02:26.775 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2024-09-22T03:02:26.775 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2024-09-22T03:02:26.775 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2024-09-22T03:02:26.775 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2024-09-22T03:02:26.775 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-22T03:02:26.775 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-22T03:02:26.775 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2024-09-22T03:02:26.775 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.775 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-22T03:02:26.775 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = 172.21.15.145 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: ms client mode = crc 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: ms cluster mode = crc 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: ms mon client mode = crc 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: ms mon cluster mode = crc 2024-09-22T03:02:26.776 INFO:teuthology.orchestra.run.smithi194.stdout: ms mon service mode = crc 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout: ms service mode = crc 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_min_size = 2 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_size = 3 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = 110716e9-1590-4d11-aa79-697b4ec9a4b0 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 120 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2024-09-22T03:02:26.777 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug trim objects = true 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.778 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: debug monc = 20 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore compression algorithm = snappy 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore compression mode = aggressive 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore rocksdb cf = False 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: crimson alien thread cpu cores = 6-7 2024-09-22T03:02:26.779 INFO:teuthology.orchestra.run.smithi194.stdout: crimson osd obc lru size = 10 2024-09-22T03:02:26.780 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 20 2024-09-22T03:02:26.780 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 20 2024-09-22T03:02:26.780 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-22T03:02:26.780 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2024-09-22T03:02:26.780 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 10 2024-09-22T03:02:26.780 INFO:teuthology.orchestra.run.smithi194.stdout: err to stderr = True 2024-09-22T03:02:26.780 INFO:teuthology.orchestra.run.smithi194.stdout: log flush on exit = True 2024-09-22T03:02:26.780 INFO:teuthology.orchestra.run.smithi194.stdout: log to file = False 2024-09-22T03:02:26.780 INFO:teuthology.orchestra.run.smithi194.stdout: log to stderr = True 2024-09-22T03:02:26.780 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2024-09-22T03:02:26.780 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2024-09-22T03:02:26.780 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2024-09-22T03:02:26.780 INFO:teuthology.orchestra.run.smithi194.stdout: osd blocked scrub grace period = 3600 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug reject backfill probability = 0.3 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout: osd delete sleep = 1 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 0.95 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout: osd max backfills = 3 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout: osd max markdown count = 1000 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = bluestore 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub min interval = 60 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout: osd shutdown pgref assert = True 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout: osd snap trim sleep = 2 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2024-09-22T03:02:26.781 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-22T03:02:26.782 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2024-09-22T03:02:26.783 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout: mon min osdmap epochs = 50 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout: mon osdmap full prune interval = 2 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout: mon osdmap full prune min = 15 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout: mon osdmap full prune txsize = 2 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default crimson = True 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout: paxos service trim min = 10 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = true 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-22T03:02:26.784 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2024-09-22T03:02:26.785 INFO:teuthology.orchestra.run.smithi194.stdout:[client.0] 2024-09-22T03:02:26.785 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-09-22T03:02:26.785 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.0] 2024-09-22T03:02:26.785 INFO:teuthology.orchestra.run.smithi194.stdout: crimson seastar cpu cores = 0-2 2024-09-22T03:02:26.785 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.1] 2024-09-22T03:02:26.785 INFO:teuthology.orchestra.run.smithi194.stdout: crimson seastar cpu cores = 3-5 2024-09-22T03:02:26.785 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.2] 2024-09-22T03:02:26.785 INFO:teuthology.orchestra.run.smithi194.stdout: crimson seastar cpu cores = 0-2 2024-09-22T03:02:26.785 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.3] 2024-09-22T03:02:26.785 INFO:teuthology.orchestra.run.smithi194.stdout: crimson seastar cpu cores = 3-5 2024-09-22T03:02:26.786 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-22T03:02:26.787 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-22T03:02:26.886 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-22T03:02:26.887 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:26.887 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-22T03:02:26.902 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:26.902 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-22T03:02:26.957 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi145.front.sepia.ceph.com 2024-09-22T03:02:26.958 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:26.958 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T03:02:26.958 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T03:02:27.031 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:27.032 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:02:27.087 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2024-09-22T03:02:27.150 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T03:02:27.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-22T03:02:27.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-22T03:02:27.185 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T03:02:27.185 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:02:27.241 INFO:tasks.ceph:Setting up mon nodes... 2024-09-22T03:02:27.241 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-22T03:02:27.241 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T03:02:27.344 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-22T03:02:27.347 INFO:tasks.ceph:Setting up mds nodes... 2024-09-22T03:02:27.347 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-22T03:02:27.347 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-22T03:02:27.393 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-22T03:02:27.406 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-22T03:02:27.452 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-22T03:02:27.465 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-22T03:02:27.465 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-09-22T03:02:27.465 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-22T03:02:27.490 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-22T03:02:27.490 INFO:tasks.ceph:role: osd.0 2024-09-22T03:02:27.490 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-22T03:02:27.490 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T03:02:27.561 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:02:27.561 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:02:27.561 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:02:27.561 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:02:27.561 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:02:27.561 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:02:27.561 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:02:27.561 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:02:27.562 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:02:27.562 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:02:28.071 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-22T03:02:28.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-22T03:02:28.073 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-22T03:02:28.172 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-22T03:02:28.208 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-22T03:02:28.273 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-09-22T03:02:28.273 INFO:tasks.ceph:role: osd.1 2024-09-22T03:02:28.273 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-22T03:02:28.274 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T03:02:28.347 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:02:28.347 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:02:28.347 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:02:28.347 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:02:28.347 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:02:28.347 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:02:28.347 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:02:28.347 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:02:28.347 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:02:28.347 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:02:28.809 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-22T03:02:28.811 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-22T03:02:28.811 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-22T03:02:28.892 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-22T03:02:28.962 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:02:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:02:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:INFO 2024-09-22 03:02:29,528 seastar - Reactor backend: linux-aio 2024-09-22T03:02:29.557 INFO:teuthology.orchestra.run.smithi145.stderr:==27796==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:02:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:INFO 2024-09-22 03:02:29,605 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:02:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:INFO 2024-09-22 03:02:29,605 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-22T03:02:29.606 INFO:teuthology.orchestra.run.smithi145.stderr:DEBUG 2024-09-22 03:02:29,605 [shard 0:main] seastar - reactor::drain 2024-09-22T03:02:30.096 INFO:teuthology.orchestra.run.smithi145.stderr:----------------------------------------------------- 2024-09-22T03:02:30.096 INFO:teuthology.orchestra.run.smithi145.stderr:Suppressions used: 2024-09-22T03:02:30.096 INFO:teuthology.orchestra.run.smithi145.stderr: count bytes template 2024-09-22T03:02:30.096 INFO:teuthology.orchestra.run.smithi145.stderr: 1 8 MallocExtension::Register 2024-09-22T03:02:30.096 INFO:teuthology.orchestra.run.smithi145.stderr:----------------------------------------------------- 2024-09-22T03:02:30.096 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-22T03:02:30.155 INFO:teuthology.orchestra.run.smithi145.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:02:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:INFO 2024-09-22 03:02:30,156 seastar - Reactor backend: linux-aio 2024-09-22T03:02:30.184 INFO:teuthology.orchestra.run.smithi145.stderr:==27792==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:02:35.277 INFO:teuthology.orchestra.run.smithi145.stderr:----------------------------------------------------- 2024-09-22T03:02:35.277 INFO:teuthology.orchestra.run.smithi145.stderr:Suppressions used: 2024-09-22T03:02:35.277 INFO:teuthology.orchestra.run.smithi145.stderr: count bytes template 2024-09-22T03:02:35.277 INFO:teuthology.orchestra.run.smithi145.stderr: 1 8 MallocExtension::Register 2024-09-22T03:02:35.277 INFO:teuthology.orchestra.run.smithi145.stderr:----------------------------------------------------- 2024-09-22T03:02:35.277 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-22T03:02:35.278 INFO:teuthology.orchestra.run.smithi145.stdout:created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid 110716e9-1590-4d11-aa79-697b4ec9a4b0 2024-09-22T03:02:35.315 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-22T03:02:35.341 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:02:35.889 INFO:teuthology.orchestra.run.smithi145.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:02:35.890 INFO:teuthology.orchestra.run.smithi145.stderr:INFO 2024-09-22 03:02:35,889 seastar - Reactor backend: linux-aio 2024-09-22T03:02:35.908 INFO:teuthology.orchestra.run.smithi145.stderr:==27983==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:02:35.955 INFO:teuthology.orchestra.run.smithi145.stderr:INFO 2024-09-22 03:02:35,954 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:02:35.955 INFO:teuthology.orchestra.run.smithi145.stderr:INFO 2024-09-22 03:02:35,954 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-22T03:02:35.955 INFO:teuthology.orchestra.run.smithi145.stderr:DEBUG 2024-09-22 03:02:35,955 [shard 0:main] seastar - reactor::drain 2024-09-22T03:02:36.445 INFO:teuthology.orchestra.run.smithi145.stderr:----------------------------------------------------- 2024-09-22T03:02:36.445 INFO:teuthology.orchestra.run.smithi145.stderr:Suppressions used: 2024-09-22T03:02:36.445 INFO:teuthology.orchestra.run.smithi145.stderr: count bytes template 2024-09-22T03:02:36.446 INFO:teuthology.orchestra.run.smithi145.stderr: 1 8 MallocExtension::Register 2024-09-22T03:02:36.446 INFO:teuthology.orchestra.run.smithi145.stderr:----------------------------------------------------- 2024-09-22T03:02:36.446 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-22T03:02:36.497 INFO:teuthology.orchestra.run.smithi145.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:02:36.499 INFO:teuthology.orchestra.run.smithi145.stderr:INFO 2024-09-22 03:02:36,498 seastar - Reactor backend: linux-aio 2024-09-22T03:02:36.527 INFO:teuthology.orchestra.run.smithi145.stderr:==27981==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:02:41.632 INFO:teuthology.orchestra.run.smithi145.stderr:----------------------------------------------------- 2024-09-22T03:02:41.632 INFO:teuthology.orchestra.run.smithi145.stderr:Suppressions used: 2024-09-22T03:02:41.632 INFO:teuthology.orchestra.run.smithi145.stderr: count bytes template 2024-09-22T03:02:41.632 INFO:teuthology.orchestra.run.smithi145.stderr: 1 8 MallocExtension::Register 2024-09-22T03:02:41.632 INFO:teuthology.orchestra.run.smithi145.stderr:----------------------------------------------------- 2024-09-22T03:02:41.632 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-22T03:02:41.632 INFO:teuthology.orchestra.run.smithi145.stdout:created object store /var/lib/ceph/osd/ceph-1 for osd.1 fsid 110716e9-1590-4d11-aa79-697b4ec9a4b0 2024-09-22T03:02:41.672 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-22T03:02:41.697 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-22T03:02:41.727 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-22T03:02:41.727 INFO:tasks.ceph:role: osd.2 2024-09-22T03:02:41.727 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-22T03:02:41.727 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-22T03:02:41.803 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:02:41.804 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:02:41.804 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:02:41.804 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:02:41.804 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:02:41.804 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:02:41.804 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:02:41.804 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:02:41.804 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:02:41.804 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:02:42.317 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-22T03:02:42.319 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-22T03:02:42.320 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-09-22T03:02:42.430 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-22T03:02:42.462 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-22T03:02:42.526 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-09-22T03:02:42.527 INFO:tasks.ceph:role: osd.3 2024-09-22T03:02:42.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-22T03:02:42.527 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-22T03:02:42.599 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-22T03:02:42.599 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-22T03:02:42.599 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-22T03:02:42.599 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-22T03:02:42.599 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-22T03:02:42.600 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-22T03:02:42.600 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-22T03:02:42.600 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-22T03:02:42.600 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-22T03:02:42.600 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-22T03:02:43.062 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-22T03:02:43.064 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-22T03:02:43.064 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-09-22T03:02:43.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-22T03:02:43.179 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:02:43.753 INFO:teuthology.orchestra.run.smithi194.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:02:43.754 INFO:teuthology.orchestra.run.smithi194.stderr:INFO 2024-09-22 03:02:43,753 seastar - Reactor backend: linux-aio 2024-09-22T03:02:43.777 INFO:teuthology.orchestra.run.smithi194.stderr:==27137==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:02:43.823 INFO:teuthology.orchestra.run.smithi194.stderr:INFO 2024-09-22 03:02:43,822 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:02:43.823 INFO:teuthology.orchestra.run.smithi194.stderr:INFO 2024-09-22 03:02:43,822 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 0-2 2024-09-22T03:02:43.823 INFO:teuthology.orchestra.run.smithi194.stderr:DEBUG 2024-09-22 03:02:43,823 [shard 0:main] seastar - reactor::drain 2024-09-22T03:02:44.336 INFO:teuthology.orchestra.run.smithi194.stderr:----------------------------------------------------- 2024-09-22T03:02:44.336 INFO:teuthology.orchestra.run.smithi194.stderr:Suppressions used: 2024-09-22T03:02:44.336 INFO:teuthology.orchestra.run.smithi194.stderr: count bytes template 2024-09-22T03:02:44.336 INFO:teuthology.orchestra.run.smithi194.stderr: 1 8 MallocExtension::Register 2024-09-22T03:02:44.336 INFO:teuthology.orchestra.run.smithi194.stderr:----------------------------------------------------- 2024-09-22T03:02:44.336 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-22T03:02:44.393 INFO:teuthology.orchestra.run.smithi194.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:02:44.395 INFO:teuthology.orchestra.run.smithi194.stderr:INFO 2024-09-22 03:02:44,394 seastar - Reactor backend: linux-aio 2024-09-22T03:02:44.430 INFO:teuthology.orchestra.run.smithi194.stderr:==27134==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:02:49.494 INFO:teuthology.orchestra.run.smithi194.stderr:----------------------------------------------------- 2024-09-22T03:02:49.494 INFO:teuthology.orchestra.run.smithi194.stderr:Suppressions used: 2024-09-22T03:02:49.494 INFO:teuthology.orchestra.run.smithi194.stderr: count bytes template 2024-09-22T03:02:49.495 INFO:teuthology.orchestra.run.smithi194.stderr: 1 8 MallocExtension::Register 2024-09-22T03:02:49.495 INFO:teuthology.orchestra.run.smithi194.stderr:----------------------------------------------------- 2024-09-22T03:02:49.495 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-22T03:02:49.495 INFO:teuthology.orchestra.run.smithi194.stdout:created object store /var/lib/ceph/osd/ceph-2 for osd.2 fsid 110716e9-1590-4d11-aa79-697b4ec9a4b0 2024-09-22T03:02:49.532 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-22T03:02:49.558 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:02:50.107 INFO:teuthology.orchestra.run.smithi194.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:02:50.108 INFO:teuthology.orchestra.run.smithi194.stderr:INFO 2024-09-22 03:02:50,107 seastar - Reactor backend: linux-aio 2024-09-22T03:02:50.126 INFO:teuthology.orchestra.run.smithi194.stderr:==27323==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:02:50.173 INFO:teuthology.orchestra.run.smithi194.stderr:INFO 2024-09-22 03:02:50,172 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-09-22T03:02:50.173 INFO:teuthology.orchestra.run.smithi194.stderr:INFO 2024-09-22 03:02:50,172 [shard 0:main] osd - get_early_config: set --thread-affinity 1 --cpuset 3-5 2024-09-22T03:02:50.173 INFO:teuthology.orchestra.run.smithi194.stderr:DEBUG 2024-09-22 03:02:50,172 [shard 0:main] seastar - reactor::drain 2024-09-22T03:02:50.670 INFO:teuthology.orchestra.run.smithi194.stderr:----------------------------------------------------- 2024-09-22T03:02:50.670 INFO:teuthology.orchestra.run.smithi194.stderr:Suppressions used: 2024-09-22T03:02:50.671 INFO:teuthology.orchestra.run.smithi194.stderr: count bytes template 2024-09-22T03:02:50.671 INFO:teuthology.orchestra.run.smithi194.stderr: 1 8 MallocExtension::Register 2024-09-22T03:02:50.671 INFO:teuthology.orchestra.run.smithi194.stderr:----------------------------------------------------- 2024-09-22T03:02:50.671 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-22T03:02:50.725 INFO:teuthology.orchestra.run.smithi194.stderr:WARNING: debug mode. Not for benchmarking or production 2024-09-22T03:02:50.727 INFO:teuthology.orchestra.run.smithi194.stderr:INFO 2024-09-22 03:02:50,726 seastar - Reactor backend: linux-aio 2024-09-22T03:02:50.754 INFO:teuthology.orchestra.run.smithi194.stderr:==27321==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-09-22T03:02:55.844 INFO:teuthology.orchestra.run.smithi194.stderr:----------------------------------------------------- 2024-09-22T03:02:55.844 INFO:teuthology.orchestra.run.smithi194.stderr:Suppressions used: 2024-09-22T03:02:55.844 INFO:teuthology.orchestra.run.smithi194.stderr: count bytes template 2024-09-22T03:02:55.844 INFO:teuthology.orchestra.run.smithi194.stderr: 1 8 MallocExtension::Register 2024-09-22T03:02:55.844 INFO:teuthology.orchestra.run.smithi194.stderr:----------------------------------------------------- 2024-09-22T03:02:55.844 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-22T03:02:55.845 INFO:teuthology.orchestra.run.smithi194.stdout:created object store /var/lib/ceph/osd/ceph-3 for osd.3 fsid 110716e9-1590-4d11-aa79-697b4ec9a4b0 2024-09-22T03:02:55.883 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-22T03:02:55.908 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-22T03:02:55.908 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:55.908 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-22T03:02:55.938 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:55.939 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-22T03:02:56.006 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T03:02:56.006 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-22T03:02:56.030 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T03:02:56.030 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-22T03:02:56.095 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T03:02:56.096 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-22T03:02:56.160 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:56.160 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-22T03:02:56.179 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T03:02:56.179 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-22T03:02:56.216 INFO:tasks.ceph:Adding keys to all mons... 2024-09-22T03:02:56.216 DEBUG:teuthology.orchestra.run.smithi145:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-22T03:02:56.247 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.0] 2024-09-22T03:02:56.247 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQDGiO9mjGNvDhAAVenTXuqQ2DtKXPiwWI6oiA== 2024-09-22T03:02:56.247 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.1] 2024-09-22T03:02:56.248 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQDMiO9mnaHXIhAApQAAg+yJff5MAhtpOr364Q== 2024-09-22T03:02:56.248 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr.x] 2024-09-22T03:02:56.248 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQDDiO9mbeN6FBAAn1B+KJtg6UclvNepqfXHjQ== 2024-09-22T03:02:56.248 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.2] 2024-09-22T03:02:56.248 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQDUiO9mIoEiHRAAXludoxuTpgp/1jHtJdY3hA== 2024-09-22T03:02:56.248 INFO:teuthology.orchestra.run.smithi145.stdout:[osd.3] 2024-09-22T03:02:56.249 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQDaiO9m0m9jMBAAT7Ak+NW4KTM1jOCgJAEwIg== 2024-09-22T03:02:56.249 INFO:teuthology.orchestra.run.smithi145.stdout:[client.0] 2024-09-22T03:02:56.249 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQDDiO9mWVNrFxAAACOWFqu6TCgjq7RxoNa1+w== 2024-09-22T03:02:56.249 INFO:teuthology.orchestra.run.smithi145.stdout:[client.1] 2024-09-22T03:02:56.249 INFO:teuthology.orchestra.run.smithi145.stdout: key = AQDDiO9mRcfxGhAAZgnd9fYUDGSlhcmfyO7qgQ== 2024-09-22T03:02:56.251 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:02:56.355 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:02:56.414 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-22T03:02:56.471 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:02:56.528 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-22T03:02:56.584 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T03:02:56.643 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-22T03:02:56.702 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-22T03:02:56.702 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-22T03:02:56.727 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-22T03:02:56.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:02:56.819+0000 7fe6fae92b40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:56.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:02:56.819+0000 7fe6fae92b40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:56.834 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-22T03:02:56.858 DEBUG:teuthology.orchestra.run.smithi145:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-22T03:02:56.914 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-22T03:02:56.914 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-22T03:02:56.914 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-22T03:02:56.956 INFO:tasks.ceph.mon.a:Started 2024-09-22T03:02:56.956 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-22T03:02:56.956 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-22T03:02:56.956 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-22T03:02:56.958 INFO:tasks.ceph.mgr.x:Started 2024-09-22T03:02:56.959 INFO:tasks.ceph:Setting crush tunables to default 2024-09-22T03:02:56.959 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd crush tunables default 2024-09-22T03:02:57.032 INFO:tasks.ceph.mon.a.smithi145.stderr:2024-09-22T03:02:57.030+0000 7f94eab26b40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:57.032 INFO:tasks.ceph.mon.a.smithi145.stderr:2024-09-22T03:02:57.030+0000 7f94eab26b40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:57.032 INFO:tasks.ceph.mon.a.smithi145.stderr:2024-09-22T03:02:57.030+0000 7f94eab26b40 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:57.052 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:57.051+0000 7fd8e71cdf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:57.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:02:57.055+0000 7eff8bb0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:57.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:02:57.075+0000 7eff8bb0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:57.077 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:57.075+0000 7fd8e71cdf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:57.077 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:57.075+0000 7fd8e71cdf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:57.143 INFO:teuthology.orchestra.run.smithi145.stderr:adjusted tunables profile to default 2024-09-22T03:02:57.155 INFO:tasks.ceph:check_enable_crimson: True 2024-09-22T03:02:57.155 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-09-22T03:02:57.155 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-09-22T03:02:57.176 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:57.174+0000 7fd8e71cdf00 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-22T03:02:57.217 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:57.215+0000 7fd8e71cdf00 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-22T03:02:57.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:02:57.251+0000 7fa7e3f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:57.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:02:57.258+0000 7fa7e3f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:57.335 INFO:tasks.ceph.mon.a.smithi145.stderr:2024-09-22T03:02:57.333+0000 7f94e2df1640 -1 WARNING: experimental feature 'crimson' is enabled 2024-09-22T03:02:57.335 INFO:tasks.ceph.mon.a.smithi145.stderr:Please be aware that this feature is experimental, untested, 2024-09-22T03:02:57.335 INFO:tasks.ceph.mon.a.smithi145.stderr:unsupported, and may result in data corruption, data loss, 2024-09-22T03:02:57.335 INFO:tasks.ceph.mon.a.smithi145.stderr:and/or irreparable damage to your cluster. Do not use 2024-09-22T03:02:57.335 INFO:tasks.ceph.mon.a.smithi145.stderr:feature with important data. 2024-09-22T03:02:57.335 INFO:tasks.ceph.mon.a.smithi145.stderr: 2024-09-22T03:02:57.351 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:57.349+0000 7fd8e71cdf00 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-22T03:02:57.401 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:57.399+0000 7fd8e71cdf00 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-22T03:02:57.557 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:57.555+0000 7fd8e71cdf00 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-22T03:02:57.667 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:57.665+0000 7fd8e71cdf00 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-22T03:02:58.007 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:58.005+0000 7fd8e71cdf00 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-22T03:02:58.057 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:58.055+0000 7fd8e71cdf00 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-22T03:02:58.157 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-22T03:02:58.157 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:58.158 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-22T03:02:58.184 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-22T03:02:58.184 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-22T03:02:58.207 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:58.205+0000 7fd8e71cdf00 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-22T03:02:58.249 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T03:02:58.249 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-22T03:02:58.275 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-22T03:02:58.275 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-22T03:02:58.341 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 3d85fcc9-e5d4-4463-8465-afb150e1d595 0 2024-09-22T03:02:58.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-22T03:02:58.479+0000 7fbd1d717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:58.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-22T03:02:58.487+0000 7fbd1d717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:58.564 INFO:teuthology.orchestra.run.smithi194.stdout:0 2024-09-22T03:02:58.576 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 89ec4223-137c-4451-b184-e334dd762925 1 2024-09-22T03:02:58.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-22T03:02:58.673+0000 7f6084099640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:58.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-22T03:02:58.681+0000 7f6084099640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:58.758 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-22T03:02:58.769 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new d0346c80-1ff5-42a1-a9fe-82ff81bbd91e 2 2024-09-22T03:02:58.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-22T03:02:58.866+0000 7fedd3d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:58.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-22T03:02:58.874+0000 7fedd3d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:58.951 INFO:teuthology.orchestra.run.smithi194.stdout:2 2024-09-22T03:02:58.962 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 974b2daf-1154-410d-a87f-c085313352a8 3 2024-09-22T03:02:59.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-22T03:02:59.059+0000 7f347dcb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:59.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-22T03:02:59.068+0000 7f347dcb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:59.148 INFO:teuthology.orchestra.run.smithi194.stdout:3 2024-09-22T03:02:59.159 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-09-22T03:02:59.192 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-22T03:02:59.192 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-09-22T03:02:59.226 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:59.224+0000 7fd8e71cdf00 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-22T03:02:59.235 INFO:tasks.ceph.osd.0:Started 2024-09-22T03:02:59.235 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-09-22T03:02:59.265 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-22T03:02:59.266 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-09-22T03:02:59.278 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:59.276+0000 7fd8e71cdf00 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-22T03:02:59.308 INFO:tasks.ceph.osd.1:Started 2024-09-22T03:02:59.308 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-09-22T03:02:59.338 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-22T03:02:59.338 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-09-22T03:02:59.380 INFO:tasks.ceph.osd.2:Started 2024-09-22T03:02:59.380 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-09-22T03:02:59.408 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-22T03:02:59.408 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-09-22T03:02:59.451 INFO:tasks.ceph.osd.3:Started 2024-09-22T03:02:59.451 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:02:59.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:02:59.568+0000 7fd2e7d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:59.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:02:59.577+0000 7fd2e7d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:02:59.647 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:02:59.648 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":7,"fsid":"110716e9-1590-4d11-aa79-697b4ec9a4b0","created":"2024-09-22T03:02:57.063974+0000","modified":"2024-09-22T03:02:59.144490+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T03:02:59.144490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"3d85fcc9-e5d4-4463-8465-afb150e1d595","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"89ec4223-137c-4451-b184-e334dd762925","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d0346c80-1ff5-42a1-a9fe-82ff81bbd91e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"974b2daf-1154-410d-a87f-c085313352a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:02:59.661 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-22T03:02:59.661 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-22T03:02:59.696 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:59.694+0000 7fd8e71cdf00 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-22T03:02:59.798 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:59.796+0000 7fd8e71cdf00 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-22T03:02:59.919 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:59.917+0000 7fd8e71cdf00 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-22T03:02:59.970 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:02:59.968+0000 7fd8e71cdf00 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-22T03:03:00.064 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T03:03:00.089 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:03:00.087+0000 7fd8e71cdf00 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-22T03:03:00.148 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:03:00.146+0000 7fd8e71cdf00 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-22T03:03:00.165 INFO:teuthology.misc.health.smithi145.stderr:2024-09-22T03:03:00.160+0000 7f08ef517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:00.168 INFO:teuthology.misc.health.smithi145.stderr:2024-09-22T03:03:00.167+0000 7f08ef517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:00.197 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:03:00.196+0000 7fd8e71cdf00 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-22T03:03:00.233 INFO:teuthology.misc.health.smithi145.stdout: 2024-09-22T03:03:00.234 INFO:teuthology.misc.health.smithi145.stdout:{"epoch":7,"fsid":"110716e9-1590-4d11-aa79-697b4ec9a4b0","created":"2024-09-22T03:02:57.063974+0000","modified":"2024-09-22T03:02:59.144490+0000","last_up_change":"0.000000","last_in_change":"2024-09-22T03:02:59.144490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"3d85fcc9-e5d4-4463-8465-afb150e1d595","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"89ec4223-137c-4451-b184-e334dd762925","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d0346c80-1ff5-42a1-a9fe-82ff81bbd91e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"974b2daf-1154-410d-a87f-c085313352a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:03:00.244 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-22T03:03:00.320 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:03:00.318+0000 7fd8e71cdf00 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-22T03:03:00.374 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:03:00.372+0000 7fd8e71cdf00 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-22T03:03:00.430 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:03:00.428+0000 7fd8e71cdf00 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-22T03:03:00.504 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:03:00.502+0000 7fd8e71cdf00 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-22T03:03:00.552 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:03:00.551+0000 7fd8e71cdf00 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-22T03:03:00.601 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:03:00.599+0000 7fd8e71cdf00 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-22T03:03:01.300 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:03:01.299+0000 7fd8e71cdf00 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-22T03:03:02.310 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-22T03:03:02.308+0000 7fd885986640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-22T03:03:06.648 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-22T03:03:06.756 INFO:teuthology.misc.health.smithi145.stderr:2024-09-22T03:03:06.750+0000 7fbd680b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:06.759 INFO:teuthology.misc.health.smithi145.stderr:2024-09-22T03:03:06.757+0000 7fbd680b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:06.934 INFO:teuthology.misc.health.smithi145.stdout: 2024-09-22T03:03:06.935 INFO:teuthology.misc.health.smithi145.stdout:{"epoch":10,"fsid":"110716e9-1590-4d11-aa79-697b4ec9a4b0","created":"2024-09-22T03:02:57.063974+0000","modified":"2024-09-22T03:03:05.317100+0000","last_up_change":"2024-09-22T03:03:05.317100+0000","last_in_change":"2024-09-22T03:02:59.144490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"3d85fcc9-e5d4-4463-8465-afb150e1d595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2286030306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6801","nonce":2286030306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":2286030306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2286030306}]},"public_addr":"172.21.15.145:6802/2286030306","cluster_addr":"172.21.15.145:6801/2286030306","heartbeat_back_addr":"172.21.15.145:6805/2286030306","heartbeat_front_addr":"172.21.15.145:6806/2286030306","state":["exists","up"]},{"osd":1,"uuid":"89ec4223-137c-4451-b184-e334dd762925","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3284590914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":3284590914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":3284590914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":3284590914}]},"public_addr":"172.21.15.145:6804/3284590914","cluster_addr":"172.21.15.145:6803/3284590914","heartbeat_back_addr":"172.21.15.145:6814/3284590914","heartbeat_front_addr":"172.21.15.145:6813/3284590914","state":["exists","up"]},{"osd":2,"uuid":"d0346c80-1ff5-42a1-a9fe-82ff81bbd91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":792102490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":792102490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":792102490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6807","nonce":792102490}]},"public_addr":"172.21.15.194:6804/792102490","cluster_addr":"172.21.15.194:6805/792102490","heartbeat_back_addr":"172.21.15.194:6808/792102490","heartbeat_front_addr":"172.21.15.194:6807/792102490","state":["exists","up"]},{"osd":3,"uuid":"974b2daf-1154-410d-a87f-c085313352a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6803","nonce":2433098210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2433098210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":2433098210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2433098210}]},"public_addr":"172.21.15.194:6803/2433098210","cluster_addr":"172.21.15.194:6802/2433098210","heartbeat_back_addr":"172.21.15.194:6811/2433098210","heartbeat_front_addr":"172.21.15.194:6810/2433098210","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:03:06.946 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-22T03:03:06.946 INFO:tasks.ceph:Creating RBD pool 2024-09-22T03:03:06.947 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-22T03:03:07.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:07.042+0000 7f388ea2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:07.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:07.052+0000 7f388ea2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:07.338 INFO:teuthology.orchestra.run.smithi145.stderr:pool 'rbd' created 2024-09-22T03:03:07.355 DEBUG:teuthology.orchestra.run.smithi145:> rbd --cluster ceph pool init rbd 2024-09-22T03:03:07.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:07.416+0000 7fe6c8a2dd00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:07.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:07.416+0000 7fe6c8a2dd00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:07.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:07.421+0000 7fe6c8a2dd00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:10.378 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-22T03:03:10.378 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-22T03:03:10.378 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-22T03:03:10.379 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-22T03:03:10.379 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-22T03:03:10.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:10.484+0000 7f59e366c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:10.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:10.490+0000 7f59e366c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:10.712 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:10.724 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":273744419},{"type":"v1","addr":"172.21.15.194:6801","nonce":273744419}]},"active_addr":"172.21.15.194:6801/273744419","active_change":"2024-09-22T03:03:01.301597+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":94337112}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":2205759161}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":1082387980}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.194:0","nonce":3726373276}]}]} 2024-09-22T03:03:10.726 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-22T03:03:10.726 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T03:03:10.726 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:03:10.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:10.824+0000 7f3c9b4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:10.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:10.831+0000 7f3c9b4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.008 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:11.008 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":14,"fsid":"110716e9-1590-4d11-aa79-697b4ec9a4b0","created":"2024-09-22T03:02:57.063974+0000","modified":"2024-09-22T03:03:10.341898+0000","last_up_change":"2024-09-22T03:03:05.317100+0000","last_in_change":"2024-09-22T03:02:59.144490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-22T03:03:07.249906+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-09-22T03:03:07.334071+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d85fcc9-e5d4-4463-8465-afb150e1d595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2286030306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6801","nonce":2286030306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":2286030306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2286030306}]},"public_addr":"172.21.15.145:6802/2286030306","cluster_addr":"172.21.15.145:6801/2286030306","heartbeat_back_addr":"172.21.15.145:6805/2286030306","heartbeat_front_addr":"172.21.15.145:6806/2286030306","state":["exists","up"]},{"osd":1,"uuid":"89ec4223-137c-4451-b184-e334dd762925","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3284590914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":3284590914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":3284590914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":3284590914}]},"public_addr":"172.21.15.145:6804/3284590914","cluster_addr":"172.21.15.145:6803/3284590914","heartbeat_back_addr":"172.21.15.145:6814/3284590914","heartbeat_front_addr":"172.21.15.145:6813/3284590914","state":["exists","up"]},{"osd":2,"uuid":"d0346c80-1ff5-42a1-a9fe-82ff81bbd91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":792102490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":792102490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":792102490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6807","nonce":792102490}]},"public_addr":"172.21.15.194:6804/792102490","cluster_addr":"172.21.15.194:6805/792102490","heartbeat_back_addr":"172.21.15.194:6808/792102490","heartbeat_front_addr":"172.21.15.194:6807/792102490","state":["exists","up"]},{"osd":3,"uuid":"974b2daf-1154-410d-a87f-c085313352a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6803","nonce":2433098210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2433098210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":2433098210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2433098210}]},"public_addr":"172.21.15.194:6803/2433098210","cluster_addr":"172.21.15.194:6802/2433098210","heartbeat_back_addr":"172.21.15.194:6811/2433098210","heartbeat_front_addr":"172.21.15.194:6810/2433098210","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:03:11.021 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T03:03:11.021 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:03:11.125 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.120+0000 7f79060c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.127+0000 7f79060c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.306 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:11.306 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":14,"fsid":"110716e9-1590-4d11-aa79-697b4ec9a4b0","created":"2024-09-22T03:02:57.063974+0000","modified":"2024-09-22T03:03:10.341898+0000","last_up_change":"2024-09-22T03:03:05.317100+0000","last_in_change":"2024-09-22T03:02:59.144490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-22T03:03:07.249906+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-09-22T03:03:07.334071+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d85fcc9-e5d4-4463-8465-afb150e1d595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2286030306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6801","nonce":2286030306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":2286030306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2286030306}]},"public_addr":"172.21.15.145:6802/2286030306","cluster_addr":"172.21.15.145:6801/2286030306","heartbeat_back_addr":"172.21.15.145:6805/2286030306","heartbeat_front_addr":"172.21.15.145:6806/2286030306","state":["exists","up"]},{"osd":1,"uuid":"89ec4223-137c-4451-b184-e334dd762925","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3284590914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":3284590914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":3284590914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":3284590914}]},"public_addr":"172.21.15.145:6804/3284590914","cluster_addr":"172.21.15.145:6803/3284590914","heartbeat_back_addr":"172.21.15.145:6814/3284590914","heartbeat_front_addr":"172.21.15.145:6813/3284590914","state":["exists","up"]},{"osd":2,"uuid":"d0346c80-1ff5-42a1-a9fe-82ff81bbd91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":792102490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":792102490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":792102490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6807","nonce":792102490}]},"public_addr":"172.21.15.194:6804/792102490","cluster_addr":"172.21.15.194:6805/792102490","heartbeat_back_addr":"172.21.15.194:6808/792102490","heartbeat_front_addr":"172.21.15.194:6807/792102490","state":["exists","up"]},{"osd":3,"uuid":"974b2daf-1154-410d-a87f-c085313352a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6803","nonce":2433098210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2433098210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":2433098210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2433098210}]},"public_addr":"172.21.15.194:6803/2433098210","cluster_addr":"172.21.15.194:6802/2433098210","heartbeat_back_addr":"172.21.15.194:6811/2433098210","heartbeat_front_addr":"172.21.15.194:6810/2433098210","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:03:11.318 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T03:03:11.319 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T03:03:11.319 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T03:03:11.320 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-22T03:03:11.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.428+0000 7fb0b8397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.429+0000 7f6cd6423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.436+0000 7fb0b8397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.438+0000 7f6cd6423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.453+0000 7f5e2e0a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.458+0000 7fbedc197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.464+0000 7f5e2e0a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.468 INFO:teuthology.orchestra.run.smithi145.stdout:42949672966 2024-09-22T03:03:11.468 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T03:03:11.469 INFO:teuthology.orchestra.run.smithi145.stdout:42949672966 2024-09-22T03:03:11.470 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T03:03:11.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.469+0000 7fbedc197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.492 INFO:teuthology.orchestra.run.smithi145.stdout:38654705671 2024-09-22T03:03:11.493 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T03:03:11.499 INFO:teuthology.orchestra.run.smithi145.stdout:42949672966 2024-09-22T03:03:11.500 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T03:03:11.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.579+0000 7f58bb597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.587+0000 7f58bb597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.583+0000 7f23b1157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.592+0000 7f23b1157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.658+0000 7f1d54317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.658+0000 7fee3a597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.666+0000 7f1d54317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:11.667+0000 7fee3a597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:11.802 INFO:teuthology.orchestra.run.smithi145.stdout:42949672966 2024-09-22T03:03:11.809 INFO:teuthology.orchestra.run.smithi145.stdout:42949672966 2024-09-22T03:03:11.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.1 2024-09-22T03:03:11.820 DEBUG:teuthology.parallel:result is None 2024-09-22T03:03:11.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.3 2024-09-22T03:03:11.827 DEBUG:teuthology.parallel:result is None 2024-09-22T03:03:11.864 INFO:teuthology.orchestra.run.smithi145.stdout:38654705668 2024-09-22T03:03:11.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705668 for osd.0 2024-09-22T03:03:11.877 INFO:teuthology.orchestra.run.smithi145.stdout:42949672966 2024-09-22T03:03:11.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.2 2024-09-22T03:03:11.889 DEBUG:teuthology.parallel:result is None 2024-09-22T03:03:12.878 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T03:03:12.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:12.979+0000 7fae0be2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:12.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:12.987+0000 7fae0be2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:13.168 INFO:teuthology.orchestra.run.smithi145.stdout:38654705668 2024-09-22T03:03:13.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705668 for osd.0 2024-09-22T03:03:14.182 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T03:03:14.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:14.293+0000 7f9eab50e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:14.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:14.301+0000 7f9eab50e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:14.485 INFO:teuthology.orchestra.run.smithi145.stdout:38654705671 2024-09-22T03:03:14.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-09-22T03:03:14.498 DEBUG:teuthology.parallel:result is None 2024-09-22T03:03:14.498 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T03:03:14.499 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:03:14.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:14.598+0000 7fd5f3517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:14.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:14.604+0000 7fd5f3517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:14.782 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:14.782 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:03:14.794 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-22T03:03:13.306028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108020,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379340,"statfs":{"total":386547056640,"available":386436444160,"internally_reserved":0,"allocated":671744,"data_stored":1894113,"data_compressed":89886,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.966379"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362046+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:10.362046+0000","last_peered":"2024-09-22T03:03:10.362046+0000","last_clean":"2024-09-22T03:03:10.362046+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:10.362046+0000","last_undegraded":"2024-09-22T03:03:10.362046+0000","last_fullsized":"2024-09-22T03:03:10.362046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362103+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:10.362103+0000","last_peered":"2024-09-22T03:03:10.362103+0000","last_clean":"2024-09-22T03:03:10.362103+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:10.362103+0000","last_undegraded":"2024-09-22T03:03:10.362103+0000","last_fullsized":"2024-09-22T03:03:10.362103+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362742+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:10.362742+0000","last_peered":"2024-09-22T03:03:10.362742+0000","last_clean":"2024-09-22T03:03:10.362742+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:10.362742+0000","last_undegraded":"2024-09-22T03:03:10.362742+0000","last_fullsized":"2024-09-22T03:03:10.362742+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359106+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:10.359106+0000","last_peered":"2024-09-22T03:03:10.359106+0000","last_clean":"2024-09-22T03:03:10.359106+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:10.359106+0000","last_undegraded":"2024-09-22T03:03:10.359106+0000","last_fullsized":"2024-09-22T03:03:10.359106+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":142,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362046+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:03:10.362046+0000","last_peered":"2024-09-22T03:03:10.362046+0000","last_clean":"2024-09-22T03:03:10.362046+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:03:10.362046+0000","last_undegraded":"2024-09-22T03:03:10.362046+0000","last_fullsized":"2024-09-22T03:03:10.362046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362415+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:10.362415+0000","last_peered":"2024-09-22T03:03:10.362415+0000","last_clean":"2024-09-22T03:03:10.362415+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:10.362415+0000","last_undegraded":"2024-09-22T03:03:10.362415+0000","last_fullsized":"2024-09-22T03:03:10.362415+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"13'1","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362354+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:10.362354+0000","last_peered":"2024-09-22T03:03:10.362354+0000","last_clean":"2024-09-22T03:03:10.362354+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:10.362354+0000","last_undegraded":"2024-09-22T03:03:10.362354+0000","last_fullsized":"2024-09-22T03:03:10.362354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359123+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:03:10.359123+0000","last_peered":"2024-09-22T03:03:10.359123+0000","last_clean":"2024-09-22T03:03:10.359123+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:03:10.359123+0000","last_undegraded":"2024-09-22T03:03:10.359123+0000","last_fullsized":"2024-09-22T03:03:10.359123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359530+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:10.359530+0000","last_peered":"2024-09-22T03:03:10.359530+0000","last_clean":"2024-09-22T03:03:10.359530+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:10.359530+0000","last_undegraded":"2024-09-22T03:03:10.359530+0000","last_fullsized":"2024-09-22T03:03:10.359530+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":30757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":180224,"data_stored":621106,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:03:14.794 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:03:14.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:14.893+0000 7ff9c370e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:14.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:14.899+0000 7ff9c370e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:15.075 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:15.075 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:03:15.087 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-09-22T03:03:13.306028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108020,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379340,"statfs":{"total":386547056640,"available":386436444160,"internally_reserved":0,"allocated":671744,"data_stored":1894113,"data_compressed":89886,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.966379"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362046+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:10.362046+0000","last_peered":"2024-09-22T03:03:10.362046+0000","last_clean":"2024-09-22T03:03:10.362046+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:10.362046+0000","last_undegraded":"2024-09-22T03:03:10.362046+0000","last_fullsized":"2024-09-22T03:03:10.362046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362103+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:10.362103+0000","last_peered":"2024-09-22T03:03:10.362103+0000","last_clean":"2024-09-22T03:03:10.362103+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:10.362103+0000","last_undegraded":"2024-09-22T03:03:10.362103+0000","last_fullsized":"2024-09-22T03:03:10.362103+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362742+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:10.362742+0000","last_peered":"2024-09-22T03:03:10.362742+0000","last_clean":"2024-09-22T03:03:10.362742+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:10.362742+0000","last_undegraded":"2024-09-22T03:03:10.362742+0000","last_fullsized":"2024-09-22T03:03:10.362742+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359106+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:10.359106+0000","last_peered":"2024-09-22T03:03:10.359106+0000","last_clean":"2024-09-22T03:03:10.359106+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:10.359106+0000","last_undegraded":"2024-09-22T03:03:10.359106+0000","last_fullsized":"2024-09-22T03:03:10.359106+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":142,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362046+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:03:10.362046+0000","last_peered":"2024-09-22T03:03:10.362046+0000","last_clean":"2024-09-22T03:03:10.362046+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:03:10.362046+0000","last_undegraded":"2024-09-22T03:03:10.362046+0000","last_fullsized":"2024-09-22T03:03:10.362046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362415+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:10.362415+0000","last_peered":"2024-09-22T03:03:10.362415+0000","last_clean":"2024-09-22T03:03:10.362415+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:10.362415+0000","last_undegraded":"2024-09-22T03:03:10.362415+0000","last_fullsized":"2024-09-22T03:03:10.362415+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"13'1","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362354+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:10.362354+0000","last_peered":"2024-09-22T03:03:10.362354+0000","last_clean":"2024-09-22T03:03:10.362354+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:10.362354+0000","last_undegraded":"2024-09-22T03:03:10.362354+0000","last_fullsized":"2024-09-22T03:03:10.362354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359123+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:03:10.359123+0000","last_peered":"2024-09-22T03:03:10.359123+0000","last_clean":"2024-09-22T03:03:10.359123+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:03:10.359123+0000","last_undegraded":"2024-09-22T03:03:10.359123+0000","last_fullsized":"2024-09-22T03:03:10.359123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359530+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:10.359530+0000","last_peered":"2024-09-22T03:03:10.359530+0000","last_clean":"2024-09-22T03:03:10.359530+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:10.359530+0000","last_undegraded":"2024-09-22T03:03:10.359530+0000","last_fullsized":"2024-09-22T03:03:10.359530+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":30757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":180224,"data_stored":621106,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:03:15.088 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T03:03:15.088 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-22T03:03:15.088 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-22T03:03:15.088 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-22T03:03:15.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:15.187+0000 7f1fdbc58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:15.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:15.193+0000 7f1fdbc58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:15.407 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:15.407 INFO:teuthology.orchestra.run.smithi145.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-22T03:03:15.420 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-22T03:03:15.420 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-22T03:03:15.432 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 3, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-22T03:03:15.432 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'osd pool default crimson': True, 'paxos service trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'snappy', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore rocksdb cf': False, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'err to stderr': True, 'log flush on exit': True, 'log to file': False, 'log to stderr': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd debug reject backfill probability': 0.3, 'osd delete sleep': 1, 'osd failsafe full ratio': 0.95, 'osd max backfills': 3, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd scrub max interval': 120, 'osd scrub min interval': 60, 'osd shutdown pgref assert': True, 'osd snap trim sleep': 2}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'min_in': 4}, 'workunit': {'branch': 'squid', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '4e45e6b490e6cbe082cdf155fea780438ec53fc7'}} 2024-09-22T03:03:15.432 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_down': 0, 'chance_inject_pause_short': 0, 'chance_reset_purged_snaps_last': 0, 'chance_thrash_cluster_full': 0, 'chance_thrash_pg_upmap': 0, 'dump_ops_enable': False, 'min_in': 4, 'noscrub_toggle_delay': 0, 'reweight_osd': 0, 'sighup_delay': 0, 'thrash_primary_affinity': False, 'timeout': 2400, 'optrack_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-22T03:03:15.433 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-22T03:03:15.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:15.531+0000 7fc71f46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:15.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:15.541+0000 7fc71f46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:15.735 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-22T03:03:15.735 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T03:03:15.735 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:03:15.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:15.835+0000 7fca4630e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:15.842+0000 7fca4630e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:16.019 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:16.020 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:03:16.032 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-22T03:03:15.306597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108020,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379340,"statfs":{"total":386547056640,"available":386436444160,"internally_reserved":0,"allocated":671744,"data_stored":1894113,"data_compressed":89886,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.966948"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362046+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:10.362046+0000","last_peered":"2024-09-22T03:03:10.362046+0000","last_clean":"2024-09-22T03:03:10.362046+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:10.362046+0000","last_undegraded":"2024-09-22T03:03:10.362046+0000","last_fullsized":"2024-09-22T03:03:10.362046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362103+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:10.362103+0000","last_peered":"2024-09-22T03:03:10.362103+0000","last_clean":"2024-09-22T03:03:10.362103+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:10.362103+0000","last_undegraded":"2024-09-22T03:03:10.362103+0000","last_fullsized":"2024-09-22T03:03:10.362103+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362742+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:10.362742+0000","last_peered":"2024-09-22T03:03:10.362742+0000","last_clean":"2024-09-22T03:03:10.362742+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:10.362742+0000","last_undegraded":"2024-09-22T03:03:10.362742+0000","last_fullsized":"2024-09-22T03:03:10.362742+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359106+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:10.359106+0000","last_peered":"2024-09-22T03:03:10.359106+0000","last_clean":"2024-09-22T03:03:10.359106+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:10.359106+0000","last_undegraded":"2024-09-22T03:03:10.359106+0000","last_fullsized":"2024-09-22T03:03:10.359106+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":142,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362046+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:03:10.362046+0000","last_peered":"2024-09-22T03:03:10.362046+0000","last_clean":"2024-09-22T03:03:10.362046+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:03:10.362046+0000","last_undegraded":"2024-09-22T03:03:10.362046+0000","last_fullsized":"2024-09-22T03:03:10.362046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362415+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:10.362415+0000","last_peered":"2024-09-22T03:03:10.362415+0000","last_clean":"2024-09-22T03:03:10.362415+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:10.362415+0000","last_undegraded":"2024-09-22T03:03:10.362415+0000","last_fullsized":"2024-09-22T03:03:10.362415+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"13'1","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362354+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:10.362354+0000","last_peered":"2024-09-22T03:03:10.362354+0000","last_clean":"2024-09-22T03:03:10.362354+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:10.362354+0000","last_undegraded":"2024-09-22T03:03:10.362354+0000","last_fullsized":"2024-09-22T03:03:10.362354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359123+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:03:10.359123+0000","last_peered":"2024-09-22T03:03:10.359123+0000","last_clean":"2024-09-22T03:03:10.359123+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:03:10.359123+0000","last_undegraded":"2024-09-22T03:03:10.359123+0000","last_fullsized":"2024-09-22T03:03:10.359123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359530+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:10.359530+0000","last_peered":"2024-09-22T03:03:10.359530+0000","last_clean":"2024-09-22T03:03:10.359530+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:10.359530+0000","last_undegraded":"2024-09-22T03:03:10.359530+0000","last_fullsized":"2024-09-22T03:03:10.359530+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":30757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":180224,"data_stored":621106,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:03:16.032 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:03:16.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:16.131+0000 7f39bc458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:16.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:16.138+0000 7f39bc458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:16.316 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:16.316 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:03:16.329 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2024-09-22T03:03:15.306597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108020,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379340,"statfs":{"total":386547056640,"available":386436444160,"internally_reserved":0,"allocated":671744,"data_stored":1894113,"data_compressed":89886,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.966948"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362046+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:10.362046+0000","last_peered":"2024-09-22T03:03:10.362046+0000","last_clean":"2024-09-22T03:03:10.362046+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:10.362046+0000","last_undegraded":"2024-09-22T03:03:10.362046+0000","last_fullsized":"2024-09-22T03:03:10.362046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362103+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:10.362103+0000","last_peered":"2024-09-22T03:03:10.362103+0000","last_clean":"2024-09-22T03:03:10.362103+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:10.362103+0000","last_undegraded":"2024-09-22T03:03:10.362103+0000","last_fullsized":"2024-09-22T03:03:10.362103+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362742+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:10.362742+0000","last_peered":"2024-09-22T03:03:10.362742+0000","last_clean":"2024-09-22T03:03:10.362742+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:10.362742+0000","last_undegraded":"2024-09-22T03:03:10.362742+0000","last_fullsized":"2024-09-22T03:03:10.362742+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359106+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:10.359106+0000","last_peered":"2024-09-22T03:03:10.359106+0000","last_clean":"2024-09-22T03:03:10.359106+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:10.359106+0000","last_undegraded":"2024-09-22T03:03:10.359106+0000","last_fullsized":"2024-09-22T03:03:10.359106+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":142,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362046+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:03:10.362046+0000","last_peered":"2024-09-22T03:03:10.362046+0000","last_clean":"2024-09-22T03:03:10.362046+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:03:10.362046+0000","last_undegraded":"2024-09-22T03:03:10.362046+0000","last_fullsized":"2024-09-22T03:03:10.362046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362415+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:10.362415+0000","last_peered":"2024-09-22T03:03:10.362415+0000","last_clean":"2024-09-22T03:03:10.362415+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:10.362415+0000","last_undegraded":"2024-09-22T03:03:10.362415+0000","last_fullsized":"2024-09-22T03:03:10.362415+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"13'1","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362354+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:10.362354+0000","last_peered":"2024-09-22T03:03:10.362354+0000","last_clean":"2024-09-22T03:03:10.362354+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:10.362354+0000","last_undegraded":"2024-09-22T03:03:10.362354+0000","last_fullsized":"2024-09-22T03:03:10.362354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359123+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:03:10.359123+0000","last_peered":"2024-09-22T03:03:10.359123+0000","last_clean":"2024-09-22T03:03:10.359123+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:03:10.359123+0000","last_undegraded":"2024-09-22T03:03:10.359123+0000","last_fullsized":"2024-09-22T03:03:10.359123+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359530+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:10.359530+0000","last_peered":"2024-09-22T03:03:10.359530+0000","last_clean":"2024-09-22T03:03:10.359530+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:10.359530+0000","last_undegraded":"2024-09-22T03:03:10.359530+0000","last_fullsized":"2024-09-22T03:03:10.359530+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":30757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":180224,"data_stored":621106,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:03:16.330 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T03:03:16.330 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-22T03:03:16.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:16.437+0000 7ff173197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:16.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:16.443+0000 7ff173197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:16.623 INFO:teuthology.orchestra.run.smithi145.stdout:epoch 14 2024-09-22T03:03:16.623 INFO:teuthology.orchestra.run.smithi145.stdout:fsid 110716e9-1590-4d11-aa79-697b4ec9a4b0 2024-09-22T03:03:16.623 INFO:teuthology.orchestra.run.smithi145.stdout:created 2024-09-22T03:02:57.063974+0000 2024-09-22T03:03:16.623 INFO:teuthology.orchestra.run.smithi145.stdout:modified 2024-09-22T03:03:10.341898+0000 2024-09-22T03:03:16.623 INFO:teuthology.orchestra.run.smithi145.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-22T03:03:16.623 INFO:teuthology.orchestra.run.smithi145.stdout:crush_version 4 2024-09-22T03:03:16.623 INFO:teuthology.orchestra.run.smithi145.stdout:full_ratio 0.95 2024-09-22T03:03:16.623 INFO:teuthology.orchestra.run.smithi145.stdout:backfillfull_ratio 0.9 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout:nearfull_ratio 0.85 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout:require_min_compat_client luminous 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout:min_compat_client jewel 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout:require_osd_release squid 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout:stretch_mode_enabled false 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout:allow_crimson=true 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout:pool 1 'rbd' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 14 flags hashpspool,nopgchange,selfmanaged_snaps,crimson stripe_width 0 application rbd read_balance_score 1.50 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout: removed_snaps_queue [2~1] 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout:pool 2 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 13 flags hashpspool,nopgchange,crimson stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 4.00 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout:max_osd 4 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout:osd.0 up in weight 1 up_from 9 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.145:6802/2286030306 v2:172.21.15.145:6801/2286030306 exists,up 3d85fcc9-e5d4-4463-8465-afb150e1d595 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout:osd.1 up in weight 1 up_from 10 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.145:6804/3284590914 v2:172.21.15.145:6803/3284590914 exists,up 89ec4223-137c-4451-b184-e334dd762925 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout:osd.2 up in weight 1 up_from 10 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.194:6804/792102490 v2:172.21.15.194:6805/792102490 exists,up d0346c80-1ff5-42a1-a9fe-82ff81bbd91e 2024-09-22T03:03:16.624 INFO:teuthology.orchestra.run.smithi145.stdout:osd.3 up in weight 1 up_from 10 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.194:6803/2433098210 v2:172.21.15.194:6802/2433098210 exists,up 974b2daf-1154-410d-a87f-c085313352a8 2024-09-22T03:03:16.636 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.145:6802/2286030306 v2:172.21.15.145:6801/2286030306 exists,up 3d85fcc9-e5d4-4463-8465-afb150e1d595', 'osd.1 up in weight 1 up_from 10 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.145:6804/3284590914 v2:172.21.15.145:6803/3284590914 exists,up 89ec4223-137c-4451-b184-e334dd762925', 'osd.2 up in weight 1 up_from 10 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.194:6804/792102490 v2:172.21.15.194:6805/792102490 exists,up d0346c80-1ff5-42a1-a9fe-82ff81bbd91e', 'osd.3 up in weight 1 up_from 10 up_thru 11 down_at 0 last_clean_interval [0,0) v2:172.21.15.194:6803/2433098210 v2:172.21.15.194:6802/2433098210 exists,up 974b2daf-1154-410d-a87f-c085313352a8'] 2024-09-22T03:03:16.636 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-22T03:03:16.739 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-22T03:03:16.739 INFO:teuthology.orchestra.run.smithi145.stdout: "name": "mon.a", 2024-09-22T03:03:16.739 INFO:teuthology.orchestra.run.smithi145.stdout: "cluster": "ceph", 2024-09-22T03:03:16.740 INFO:teuthology.orchestra.run.smithi145.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-22T03:03:16.740 INFO:teuthology.orchestra.run.smithi145.stdout: "admin_socket_mode": "", 2024-09-22T03:03:16.740 INFO:teuthology.orchestra.run.smithi145.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-22T03:03:16.740 INFO:teuthology.orchestra.run.smithi145.stdout: "auth_client_required": "cephx, none", 2024-09-22T03:03:16.740 INFO:teuthology.orchestra.run.smithi145.stdout: "auth_cluster_required": "cephx", 2024-09-22T03:03:16.740 INFO:teuthology.orchestra.run.smithi145.stdout: "auth_debug": "true", 2024-09-22T03:03:16.740 INFO:teuthology.orchestra.run.smithi145.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-22T03:03:16.740 INFO:teuthology.orchestra.run.smithi145.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-22T03:03:16.740 INFO:teuthology.orchestra.run.smithi145.stdout: "auth_service_required": "cephx", 2024-09-22T03:03:16.740 INFO:teuthology.orchestra.run.smithi145.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-22T03:03:16.740 INFO:teuthology.orchestra.run.smithi145.stdout: "auth_supported": "cephx", 2024-09-22T03:03:16.740 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_aio": "true", 2024-09-22T03:03:16.740 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_aio_poll_ms": "250", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_aio_reap_max": "16", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_async_discard": "false", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_block_size": "4096", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_debug_aio": "false", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_debug_inflight_ios": "false", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_enable_discard": "false", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_flock_retry": "3", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_inject_crash": "0", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-22T03:03:16.741 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_ioring": "false", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_ioring_hipri": "false", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bdev_type": "", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_alloc_size": "1048576", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_allocator": "hybrid", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_buffered_io": "true", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_check_for_zeros": "false", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-22T03:03:16.742 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_compact_log_sync": "false", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_max_log_runway": "4194304", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_max_prefetch": "1048576", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_min_flush_size": "524288", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_min_log_runway": "1048576", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_replay_recovery": "false", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluefs_sync_write": "false", 2024-09-22T03:03:16.743 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_allocation_from_file": "true", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_allocator": "hybrid", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_bdev_label_multi": "true", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-22T03:03:16.744 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_block_create": "true", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_block_db_create": "false", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_block_db_path": "", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_block_db_size": "0", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_block_path": "", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_block_preallocate_file": "false", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_block_size": "107374182400", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_block_wal_create": "false", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_block_wal_path": "", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_block_wal_size": "100663296", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_bluefs": "true", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-22T03:03:16.745 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_autotune": "true", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_size": "0", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-22T03:03:16.746 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cache_type": "2q", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_clone_cow": "true", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_compression_mode": "none", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-22T03:03:16.747 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_csum_type": "crc32c", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_freelist": "false", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-22T03:03:16.748 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_small_allocations": "0", 2024-09-22T03:03:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-22T03:03:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_default_buffered_read": "true", 2024-09-22T03:03:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_default_buffered_write": "false", 2024-09-22T03:03:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-22T03:03:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-22T03:03:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-22T03:03:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-22T03:03:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-22T03:03:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-22T03:03:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-22T03:03:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-22T03:03:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-22T03:03:16.749 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fail_eio": "false", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_on_mount": "false", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_on_umount": "false", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-22T03:03:16.750 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_ignore_data_csum": "false", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_log_op_age": "5.000000", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_max_alloc_size": "0", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_max_blob_size": "0", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-22T03:03:16.751 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_max_deferred_txc": "32", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_min_alloc_size": "0", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_nid_prealloc": "1024", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_retry_disk_reads": "3", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_rocksdb_cf": "true", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-22T03:03:16.752 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_spdk_mem": "512", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_tracing": "false", 2024-09-22T03:03:16.753 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "bluestore_zero_block_detection": "false", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-22T03:03:16.754 INFO:teuthology.orchestra.run.smithi145.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephx_cluster_require_signatures": "false", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephx_cluster_require_version": "2", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephx_require_signatures": "false", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephx_require_version": "2", 2024-09-22T03:03:16.755 INFO:teuthology.orchestra.run.smithi145.stdout: "cephx_service_require_signatures": "false", 2024-09-22T03:03:16.756 INFO:teuthology.orchestra.run.smithi145.stdout: "cephx_service_require_version": "2", 2024-09-22T03:03:16.756 INFO:teuthology.orchestra.run.smithi145.stdout: "cephx_sign_messages": "true", 2024-09-22T03:03:16.756 INFO:teuthology.orchestra.run.smithi145.stdout: "chdir": "", 2024-09-22T03:03:16.756 INFO:teuthology.orchestra.run.smithi145.stdout: "client_acl_type": "", 2024-09-22T03:03:16.757 INFO:teuthology.orchestra.run.smithi145.stdout: "client_asio_thread_count": "2", 2024-09-22T03:03:16.757 INFO:teuthology.orchestra.run.smithi145.stdout: "client_cache_mid": "0.750000", 2024-09-22T03:03:16.757 INFO:teuthology.orchestra.run.smithi145.stdout: "client_cache_size": "16384", 2024-09-22T03:03:16.757 INFO:teuthology.orchestra.run.smithi145.stdout: "client_caps_release_delay": "5", 2024-09-22T03:03:16.757 INFO:teuthology.orchestra.run.smithi145.stdout: "client_check_pool_perm": "true", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_debug_force_sync_read": "false", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_debug_getattr_caps": "false", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_debug_inject_features": "", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_debug_inject_tick_delay": "0", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_die_on_failed_remount": "false", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_dirsize_rbytes": "true", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_force_lazyio": "false", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_fs": "", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_inject_release_failure": "false", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_max_inline_size": "4096", 2024-09-22T03:03:16.758 INFO:teuthology.orchestra.run.smithi145.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_mds_namespace": "", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_metadata": "", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_mount_gid": "-1", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_mount_timeout": "300", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_mount_uid": "-1", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_mountpoint": "/", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_notify_timeout": "10", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_oc": "true", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_oc_max_dirty": "104857600", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_oc_max_objects": "1000", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_oc_size": "209715200", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_oc_target_dirty": "8388608", 2024-09-22T03:03:16.759 INFO:teuthology.orchestra.run.smithi145.stdout: "client_permissions": "true", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "client_quota": "true", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "client_quota_df": "true", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "client_readahead_max_bytes": "0", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "client_readahead_max_periods": "4", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "client_readahead_min": "131072", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "client_reconnect_stale": "false", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "client_shutdown_timeout": "30", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "client_snapdir": ".snap", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "client_tick_interval": "1", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "client_trace": "", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "client_try_dentry_invalidate": "false", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "client_use_faked_inos": "false", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "client_use_random_mds": "false", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "clog_to_graylog": "false", 2024-09-22T03:03:16.760 INFO:teuthology.orchestra.run.smithi145.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "clog_to_graylog_port": "12201", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "clog_to_monitors": "default=true", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "clog_to_syslog": "false", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "clog_to_syslog_level": "info", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "cluster_addr": "-", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "cluster_network": "", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "cluster_network_interface": "", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "compressor_zlib_isal": "false", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "compressor_zlib_level": "5", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "compressor_zlib_winsize": "-15", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "compressor_zstd_level": "1", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-22T03:03:16.761 INFO:teuthology.orchestra.run.smithi145.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-22T03:03:16.762 INFO:teuthology.orchestra.run.smithi145.stdout: "crimson_alien_op_num_threads": "6", 2024-09-22T03:03:16.762 INFO:teuthology.orchestra.run.smithi145.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-22T03:03:16.762 INFO:teuthology.orchestra.run.smithi145.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-22T03:03:16.762 INFO:teuthology.orchestra.run.smithi145.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-22T03:03:16.762 INFO:teuthology.orchestra.run.smithi145.stdout: "crimson_osd_stat_interval": "0", 2024-09-22T03:03:16.762 INFO:teuthology.orchestra.run.smithi145.stdout: "crimson_seastar_cpu_cores": "", 2024-09-22T03:03:16.762 INFO:teuthology.orchestra.run.smithi145.stdout: "crimson_seastar_num_threads": "0", 2024-09-22T03:03:16.762 INFO:teuthology.orchestra.run.smithi145.stdout: "crush_location": "", 2024-09-22T03:03:16.762 INFO:teuthology.orchestra.run.smithi145.stdout: "crush_location_hook": "", 2024-09-22T03:03:16.762 INFO:teuthology.orchestra.run.smithi145.stdout: "crush_location_hook_timeout": "10", 2024-09-22T03:03:16.762 INFO:teuthology.orchestra.run.smithi145.stdout: "daemonize": "false", 2024-09-22T03:03:16.763 INFO:teuthology.orchestra.run.smithi145.stdout: "daos_pool": "tank", 2024-09-22T03:03:16.763 INFO:teuthology.orchestra.run.smithi145.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-22T03:03:16.763 INFO:teuthology.orchestra.run.smithi145.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-22T03:03:16.763 INFO:teuthology.orchestra.run.smithi145.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-22T03:03:16.763 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_alienstore": "0/5", 2024-09-22T03:03:16.763 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_allow_any_pool_priority": "false", 2024-09-22T03:03:16.763 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_asok": "1/5", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_asok_assert_abort": "false", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_asserts_on_shutdown": "true", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_auth": "20/20", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_bdev": "1/3", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_bluefs": "1/5", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_bluestore": "1/5", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_buffer": "0/1", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_ceph_exporter": "1/5", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_cephfs_mirror": "0/5", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_cephsqlite": "0/5", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_client": "0/5", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_compressor": "1/5", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_context": "0/1", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_crimson_interrupt": "0/5", 2024-09-22T03:03:16.764 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_crush": "1/1", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_crypto": "1/5", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_cyanstore": "0/5", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_deliberately_leak_memory": "false", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_disable_randomized_ping": "false", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_dpdk": "1/5", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_eventtrace": "1/5", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_filer": "0/1", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_filestore": "1/3", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_finisher": "1/1", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_fuse": "1/5", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_heartbeat_testing_span": "0", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_heartbeatmap": "1/5", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_javaclient": "1/5", 2024-09-22T03:03:16.765 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_journal": "1/3", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_journaler": "0/5", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_kstore": "1/5", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_lockdep": "0/1", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_mclock": "1/5", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_mds": "1/5", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_mds_balancer": "1/5", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_mds_locker": "1/5", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_mds_log": "1/5", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_mds_log_expire": "1/5", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_mds_migrator": "1/5", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_mds_quiesce": "3/5", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_memstore": "1/5", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_mgr": "2/5", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_mgrc": "1/5", 2024-09-22T03:03:16.766 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_mon": "20/20", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_monc": "0/10", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_ms": "1/1", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_none": "0/5", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_objclass": "0/5", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_objectcacher": "0/5", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_objecter": "0/1", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_optracker": "0/5", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_osd": "1/5", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_paxos": "20/20", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_perfcounter": "1/5", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_prioritycache": "1/5", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_rados": "0/5", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_rbd": "0/5", 2024-09-22T03:03:16.767 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_rbd_mirror": "0/5", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_rbd_pwl": "0/5", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_rbd_replay": "0/5", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_refs": "0/0", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_reserver": "1/1", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_rgw": "1/5", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_rgw_access": "1/5", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_rgw_datacache": "1/5", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_rgw_dbstore": "1/5", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_rgw_flight": "1/5", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_rgw_sync": "1/5", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_rocksdb": "4/5", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore": "0/5", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore_backref": "0/5", 2024-09-22T03:03:16.768 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore_cache": "0/5", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore_cleaner": "0/5", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore_device": "0/5", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore_epm": "0/5", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore_journal": "0/5", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore_lba": "0/5", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore_odata": "0/5", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore_omap": "0/5", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore_onode": "0/5", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore_t": "0/5", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_seastore_tm": "0/5", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_striper": "0/1", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_test": "0/5", 2024-09-22T03:03:16.769 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_throttle": "1/1", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_timer": "0/1", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_tp": "0/5", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "debug_trace": "1/5", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "device_failure_prediction_mode": "none", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "crimson", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "err_to_graylog": "false", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "err_to_journald": "false", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "err_to_stderr": "true", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "err_to_syslog": "false", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "event_tracing": "false", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "exporter_addr": "0.0.0.0", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "exporter_http_port": "9926", 2024-09-22T03:03:16.770 INFO:teuthology.orchestra.run.smithi145.stdout: "exporter_prio_limit": "5", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "exporter_sort_metrics": "true", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "exporter_stats_period": "5", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "fake_statfs_for_testing": "0", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "fatal_signal_handlers": "true", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "filer_max_purge_ops": "10", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "filer_max_truncate_ops": "128", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_apply_finisher_threads": "1", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_blackhole": "false", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_btrfs_clone_range": "true", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_btrfs_snap": "true", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_caller_concurrency": "10", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_collect_device_partition_information": "true", 2024-09-22T03:03:16.771 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_commit_timeout": "600.000000", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_debug_inject_read_err": "false", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_debug_omap_check": "false", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_debug_verify_split": "false", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_dump_file": "", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_fadvise": "true", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_fail_eio": "true", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_fd_cache_shards": "16", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_fd_cache_size": "128", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_fiemap": "false", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_fiemap_threshold": "4096", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-22T03:03:16.772 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_inject_stall": "0", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_journal_parallel": "false", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_journal_trailing": "false", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_journal_writeahead": "false", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_kill_at": "0", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_inline_xattrs": "0", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-22T03:03:16.773 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_xattr_value_size": "0", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_merge_threshold": "-10", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_odsync_write": "false", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_omap_backend": "rocksdb", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_omap_backend_path": "", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_op_thread_timeout": "60", 2024-09-22T03:03:16.774 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_op_threads": "2", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_punch_hole": "false", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_queue_max_ops": "50", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_seek_data_hole": "false", 2024-09-22T03:03:16.775 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_sloppy_crc": "false", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_splice": "false", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_split_multiple": "2", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_split_rand_factor": "20", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_update_to": "1000", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_wbthrottle_enable": "true", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-22T03:03:16.776 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-22T03:03:16.777 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-22T03:03:16.777 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-22T03:03:16.777 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-22T03:03:16.777 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_xfs_extsize": "false", 2024-09-22T03:03:16.777 INFO:teuthology.orchestra.run.smithi145.stdout: "filestore_zfs_snap": "false", 2024-09-22T03:03:16.777 INFO:teuthology.orchestra.run.smithi145.stdout: "fio_dir": "/tmp/fio", 2024-09-22T03:03:16.777 INFO:teuthology.orchestra.run.smithi145.stdout: "fsid": "110716e9-1590-4d11-aa79-697b4ec9a4b0", 2024-09-22T03:03:16.777 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_allow_other": "true", 2024-09-22T03:03:16.777 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_atomic_o_trunc": "true", 2024-09-22T03:03:16.777 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_big_writes": "true", 2024-09-22T03:03:16.777 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_debug": "false", 2024-09-22T03:03:16.777 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_default_permissions": "false", 2024-09-22T03:03:16.777 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_disable_pagecache": "false", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_max_write": "0", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_multithreaded": "true", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_require_active_mds": "true", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_set_user_groups": "true", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_splice_move": "true", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_splice_read": "true", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_splice_write": "true", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "fuse_use_invalidate_cb": "true", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "gss_target_name": "ceph", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "heartbeat_file": "", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "heartbeat_inject_failure": "0", 2024-09-22T03:03:16.778 INFO:teuthology.orchestra.run.smithi145.stdout: "heartbeat_interval": "5", 2024-09-22T03:03:16.779 INFO:teuthology.orchestra.run.smithi145.stdout: "host": "smithi145", 2024-09-22T03:03:16.779 INFO:teuthology.orchestra.run.smithi145.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-22T03:03:16.779 INFO:teuthology.orchestra.run.smithi145.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-22T03:03:16.779 INFO:teuthology.orchestra.run.smithi145.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-22T03:03:16.779 INFO:teuthology.orchestra.run.smithi145.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-22T03:03:16.779 INFO:teuthology.orchestra.run.smithi145.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-22T03:03:16.779 INFO:teuthology.orchestra.run.smithi145.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-22T03:03:16.779 INFO:teuthology.orchestra.run.smithi145.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-22T03:03:16.779 INFO:teuthology.orchestra.run.smithi145.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-22T03:03:16.779 INFO:teuthology.orchestra.run.smithi145.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-22T03:03:16.779 INFO:teuthology.orchestra.run.smithi145.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-22T03:03:16.779 INFO:teuthology.orchestra.run.smithi145.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-22T03:03:16.779 INFO:teuthology.orchestra.run.smithi145.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "inject_early_sigterm": "false", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "jaeger_agent_port": "6799", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "jaeger_tracing_enable": "false", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_aio": "true", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_align_min_size": "65536", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_block_align": "true", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_block_size": "4096", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_dio": "true", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_discard": "false", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_force_aio": "false", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_ignore_corruption": "false", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_max_write_bytes": "10485760", 2024-09-22T03:03:16.780 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_max_write_entries": "100", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_replay_from": "0", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_write_header_frequency": "0", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "journal_zero_on_create": "false", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "journaler_prefetch_periods": "10", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "journaler_prezero_periods": "5", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "journaler_write_head_interval": "15", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "key": "", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "keyfile": "", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-22T03:03:16.781 INFO:teuthology.orchestra.run.smithi145.stdout: "kstore_backend": "rocksdb", 2024-09-22T03:03:16.782 INFO:teuthology.orchestra.run.smithi145.stdout: "kstore_default_stripe_size": "65536", 2024-09-22T03:03:16.782 INFO:teuthology.orchestra.run.smithi145.stdout: "kstore_fsck_on_mount": "false", 2024-09-22T03:03:16.782 INFO:teuthology.orchestra.run.smithi145.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-22T03:03:16.782 INFO:teuthology.orchestra.run.smithi145.stdout: "kstore_max_bytes": "67108864", 2024-09-22T03:03:16.782 INFO:teuthology.orchestra.run.smithi145.stdout: "kstore_max_ops": "512", 2024-09-22T03:03:16.782 INFO:teuthology.orchestra.run.smithi145.stdout: "kstore_nid_prealloc": "1024", 2024-09-22T03:03:16.782 INFO:teuthology.orchestra.run.smithi145.stdout: "kstore_onode_map_size": "1024", 2024-09-22T03:03:16.782 INFO:teuthology.orchestra.run.smithi145.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-22T03:03:16.782 INFO:teuthology.orchestra.run.smithi145.stdout: "kstore_sync_submit_transaction": "false", 2024-09-22T03:03:16.782 INFO:teuthology.orchestra.run.smithi145.stdout: "kstore_sync_transaction": "false", 2024-09-22T03:03:16.782 INFO:teuthology.orchestra.run.smithi145.stdout: "librados_thread_count": "2", 2024-09-22T03:03:16.782 INFO:teuthology.orchestra.run.smithi145.stdout: "lockdep": "false", 2024-09-22T03:03:16.782 INFO:teuthology.orchestra.run.smithi145.stdout: "lockdep_force_backtrace": "false", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_coarse_timestamps": "true", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_flush_on_exit": "false", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_graylog_host": "127.0.0.1", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_graylog_port": "12201", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_max_new": "1000", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_max_recent": "10000", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_stderr_prefix": "", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_stop_at_utilization": "0.970000", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_to_file": "true", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_to_graylog": "false", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_to_journald": "false", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_to_stderr": "false", 2024-09-22T03:03:16.783 INFO:teuthology.orchestra.run.smithi145.stdout: "log_to_syslog": "false", 2024-09-22T03:03:16.784 INFO:teuthology.orchestra.run.smithi145.stdout: "max_rotating_auth_attempts": "10", 2024-09-22T03:03:16.784 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-22T03:03:16.784 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_action_on_write_error": "1", 2024-09-22T03:03:16.784 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_alternate_name_max": "8192", 2024-09-22T03:03:16.784 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_asio_thread_count": "2", 2024-09-22T03:03:16.784 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_export_pin": "true", 2024-09-22T03:03:16.784 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_fragment_dirs": "true", 2024-09-22T03:03:16.784 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-22T03:03:16.784 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_fragment_interval": "5", 2024-09-22T03:03:16.784 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-22T03:03:16.784 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-22T03:03:16.784 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_interval": "10", 2024-09-22T03:03:16.784 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_max": "-1", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_max_until": "-1", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_merge_size": "50", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_midchunk": "0.300000", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_min_start": "0.200000", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_minchunk": "0.001000", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_mode": "0", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_need_max": "1.200000", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_need_min": "0.800000", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_overload_epochs": "2", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_split_bits": "3", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-22T03:03:16.785 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_split_size": "10000", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_target_decay": "10.000000", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_beacon_grace": "15.000000", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_beacon_interval": "4.000000", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache_mid": "0.700000", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache_quiesce_delay": "0", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-22T03:03:16.786 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache_release_free_interval": "10", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache_reservation": "0.050000", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache_trim_interval": "1", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cache_trim_threshold": "262144", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_client_prealloc_inos": "1000", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_connect_bootstrapping": "false", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_damage_table_max_entries": "10000", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_debug_auth_pins": "false", 2024-09-22T03:03:16.787 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_debug_frag": "false", 2024-09-22T03:03:16.788 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_debug_scatterstat": "false", 2024-09-22T03:03:16.788 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_debug_subtrees": "false", 2024-09-22T03:03:16.788 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_decay_halflife": "5.000000", 2024-09-22T03:03:16.788 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_default_dir_hash": "2", 2024-09-22T03:03:16.788 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_defer_session_stale": "true", 2024-09-22T03:03:16.788 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_deny_all_reconnect": "false", 2024-09-22T03:03:16.788 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_dir_keys_per_op": "16384", 2024-09-22T03:03:16.788 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_dir_max_commit_size": "10", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_dir_max_entries": "0", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_dir_prefetch": "true", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_dump_cache_on_map": "false", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_early_reply": "true", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_enable_op_tracker": "true", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_enforce_unique_name": "true", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_export_ephemeral_random": "true", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-22T03:03:16.789 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_health_summarize_threshold": "10", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_inject_health_dummy": "false", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_inject_migrator_session_race": "false", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-22T03:03:16.790 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_join_fs": "", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_journal_format": "1", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_kill_create_at": "0", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_kill_export_at": "0", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_kill_import_at": "0", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_kill_journal_at": "0", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_kill_journal_expire_at": "0", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_kill_journal_replay_at": "0", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_kill_link_at": "0", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_kill_mdstable_at": "0", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_kill_openc_at": "0", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_kill_rename_at": "0", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_kill_shutdown_at": "0", 2024-09-22T03:03:16.791 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log_event_large_threshold": "524288", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log_events_per_segment": "1024", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log_max_events": "-1", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log_max_segments": "128", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log_pause": "false", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log_segment_size": "0", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log_trim_threshold": "128", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_log_warn_factor": "2.000000", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_max_caps_per_client": "1048576", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_max_completed_flushes": "100000", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_max_completed_requests": "100000", 2024-09-22T03:03:16.792 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_max_export_size": "20971520", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_max_file_recover": "32", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_max_purge_files": "64", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_max_purge_ops": "8192", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_max_snaps_per_dir": "100", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_metrics_update_interval": "2", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_min_caps_per_client": "100", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_min_caps_working_set": "10000", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_numa_node": "-1", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_op_complaint_time": "30.000000", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_op_history_duration": "600", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_op_history_size": "20", 2024-09-22T03:03:16.793 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_op_history_slow_op_size": "20", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_op_log_threshold": "5", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_ping_grace": "15", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_ping_interval": "5", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_recall_max_caps": "30000", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_recall_warning_threshold": "262144", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_replay_interval": "1.000000", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-22T03:03:16.794 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_root_ino_gid": "0", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_root_ino_uid": "0", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_shutdown_check": "0", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_skip_ino": "0", 2024-09-22T03:03:16.795 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_snap_max_uid": "4294967294", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_snap_min_uid": "0", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_snap_rstat": "false", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_standby_replay_damaged": "false", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_symlink_recovery": "true", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_thrash_exports": "0", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_thrash_fragments": "0", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_tick_interval": "5.000000", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_valgrind_exit": "false", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_verify_backtrace": "1", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_verify_scatter": "false", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mds_wipe_sessions": "false", 2024-09-22T03:03:16.796 INFO:teuthology.orchestra.run.smithi145.stdout: "mempool_debug": "false", 2024-09-22T03:03:16.797 INFO:teuthology.orchestra.run.smithi145.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-22T03:03:16.797 INFO:teuthology.orchestra.run.smithi145.stdout: "memstore_device_bytes": "1073741824", 2024-09-22T03:03:16.797 INFO:teuthology.orchestra.run.smithi145.stdout: "memstore_page_set": "false", 2024-09-22T03:03:16.797 INFO:teuthology.orchestra.run.smithi145.stdout: "memstore_page_size": "65536", 2024-09-22T03:03:16.797 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_client_bytes": "134217728", 2024-09-22T03:03:16.797 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_client_messages": "512", 2024-09-22T03:03:16.797 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-22T03:03:16.797 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-22T03:03:16.797 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-22T03:03:16.797 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-22T03:03:16.797 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_disabled_modules": "", 2024-09-22T03:03:16.797 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_enable_op_tracker": "true", 2024-09-22T03:03:16.797 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-22T03:03:16.798 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_max_pg_num_change": "128", 2024-09-22T03:03:16.798 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_mds_bytes": "134217728", 2024-09-22T03:03:16.798 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_mds_messages": "128", 2024-09-22T03:03:16.798 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-22T03:03:16.798 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_mon_bytes": "134217728", 2024-09-22T03:03:16.798 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_mon_messages": "128", 2024-09-22T03:03:16.798 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-22T03:03:16.798 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-22T03:03:16.798 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_op_history_duration": "600", 2024-09-22T03:03:16.798 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_op_history_size": "20", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_op_log_threshold": "5", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_osd_bytes": "536870912", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_osd_messages": "8192", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_pool": "true", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_standby_modules": "true", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_stats_period": "5", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_stats_threshold": "5", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_tick_period": "2", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_allow_pool_delete": "true", 2024-09-22T03:03:16.799 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_allow_pool_size_one": "true", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_auth_validate_all_caps": "true", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_client_bytes": "104857600", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_client_directed_command_retry": "2", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_client_hunt_parallel": "3", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_client_log_interval": "1.000000", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_client_ping_interval": "10.000000", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_client_target_rank": "-1", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-22T03:03:16.800 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-22T03:03:16.801 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-22T03:03:16.801 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_cluster_log_file_level": "debug", 2024-09-22T03:03:16.801 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_cluster_log_to_file": "true", 2024-09-22T03:03:16.801 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-22T03:03:16.801 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-22T03:03:16.801 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-22T03:03:16.801 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_cluster_log_to_journald": "false", 2024-09-22T03:03:16.801 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-22T03:03:16.801 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-22T03:03:16.801 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-22T03:03:16.801 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-22T03:03:16.801 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_compact_on_bootstrap": "false", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_compact_on_start": "false", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_compact_on_trim": "true", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_cpu_threads": "4", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_crush_min_required_version": "hammer", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_daemon_bytes": "419430400", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_data_avail_crit": "5", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_data_avail_warn": "5", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_data_size_warn": "16106127360", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-22T03:03:16.802 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_debug_dump_json": "false", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_debug_dump_transactions": "false", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_debug_extra_checks": "false", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_debug_no_require_reef": "false", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_debug_no_require_squid": "false", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_down_mkfs_grace": "120", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_down_uptime_grace": "60", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_election_default_strategy": "1", 2024-09-22T03:03:16.803 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_election_timeout": "5.000000", 2024-09-22T03:03:16.804 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-22T03:03:16.804 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_elector_ping_divisor": "2", 2024-09-22T03:03:16.804 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-22T03:03:16.804 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_enable_op_tracker": "true", 2024-09-22T03:03:16.804 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_fake_pool_delete": "false", 2024-09-22T03:03:16.804 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_force_quorum_join": "false", 2024-09-22T03:03:16.804 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-22T03:03:16.804 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_globalid_prealloc": "10000", 2024-09-22T03:03:16.804 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_health_detail_to_clog": "false", 2024-09-22T03:03:16.804 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_health_log_update_period": "5", 2024-09-22T03:03:16.804 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_health_max_detail": "50", 2024-09-22T03:03:16.804 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_health_to_clog": "true", 2024-09-22T03:03:16.804 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_health_to_clog_interval": "600", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_host": "172.21.15.145", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_host_override": "", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_initial_members": "", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_lease": "5.000000", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_log_full_interval": "50", 2024-09-22T03:03:16.805 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_log_max": "10000", 2024-09-22T03:03:16.806 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_log_max_summary": "50", 2024-09-22T03:03:16.806 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-22T03:03:16.806 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_max_log_epochs": "500", 2024-09-22T03:03:16.806 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-22T03:03:16.806 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-22T03:03:16.806 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_max_osd": "10000", 2024-09-22T03:03:16.806 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_max_pg_per_osd": "10000", 2024-09-22T03:03:16.806 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_max_pool_pg_num": "65536", 2024-09-22T03:03:16.806 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-22T03:03:16.806 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-22T03:03:16.806 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_mds_force_trim_to": "0", 2024-09-22T03:03:16.806 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_mds_skip_sanity": "false", 2024-09-22T03:03:16.806 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_memory_autotune": "true", 2024-09-22T03:03:16.807 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_memory_target": "2147483648", 2024-09-22T03:03:16.807 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_mgr_beacon_grace": "30", 2024-09-22T03:03:16.807 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-22T03:03:16.807 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_mgr_digest_period": "5", 2024-09-22T03:03:16.807 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_mgr_inactive_grace": "60", 2024-09-22T03:03:16.807 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-22T03:03:16.807 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-22T03:03:16.807 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_min_osdmap_epochs": "50", 2024-09-22T03:03:16.807 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_op_complaint_time": "30", 2024-09-22T03:03:16.807 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_op_history_duration": "600", 2024-09-22T03:03:16.807 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_op_history_size": "20", 2024-09-22T03:03:16.807 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_op_history_slow_op_size": "20", 2024-09-22T03:03:16.808 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-22T03:03:16.808 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_op_log_threshold": "5", 2024-09-22T03:03:16.808 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-22T03:03:16.808 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-22T03:03:16.808 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-22T03:03:16.808 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_auto_mark_in": "false", 2024-09-22T03:03:16.808 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-22T03:03:16.808 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-22T03:03:16.808 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-22T03:03:16.808 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_cache_size": "500", 2024-09-22T03:03:16.808 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-22T03:03:16.808 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-22T03:03:16.808 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-22T03:03:16.809 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_down_out_interval": "600", 2024-09-22T03:03:16.809 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-22T03:03:16.809 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-22T03:03:16.809 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_force_trim_to": "0", 2024-09-22T03:03:16.809 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-22T03:03:16.809 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-22T03:03:16.809 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-22T03:03:16.809 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-22T03:03:16.809 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-22T03:03:16.809 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-22T03:03:16.809 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-22T03:03:16.809 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-22T03:03:16.810 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_min_down_reporters": "2", 2024-09-22T03:03:16.810 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-22T03:03:16.810 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-22T03:03:16.810 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-22T03:03:16.810 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-22T03:03:16.810 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-22T03:03:16.810 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-22T03:03:16.810 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_report_timeout": "900", 2024-09-22T03:03:16.810 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-22T03:03:16.810 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-22T03:03:16.810 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osdmap_full_prune_interval": "2", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osdmap_full_prune_min": "15", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_osdmap_full_prune_txsize": "2", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_pg_stuck_threshold": "60", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-22T03:03:16.811 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_probe_timeout": "2.000000", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_reweight_max_change": "0.050000", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_reweight_max_osds": "4", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_scrub_interval": "86400", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_scrub_max_keys": "100", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_scrub_timeout": "300", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_session_timeout": "300", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_smart_report_timeout": "5", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_stat_smooth_intervals": "6", 2024-09-22T03:03:16.812 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-22T03:03:16.813 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_stretch_pool_min_size": "2", 2024-09-22T03:03:16.813 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_stretch_pool_size": "4", 2024-09-22T03:03:16.813 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-22T03:03:16.813 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-22T03:03:16.813 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_sync_debug": "false", 2024-09-22T03:03:16.813 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-22T03:03:16.813 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-22T03:03:16.813 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_sync_provider_kill_at": "0", 2024-09-22T03:03:16.813 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_sync_requester_kill_at": "0", 2024-09-22T03:03:16.814 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_sync_timeout": "60.000000", 2024-09-22T03:03:16.814 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_target_pg_per_osd": "100", 2024-09-22T03:03:16.814 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_tick_interval": "5", 2024-09-22T03:03:16.814 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_timecheck_interval": "300.000000", 2024-09-22T03:03:16.814 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-22T03:03:16.814 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_use_min_delay_socket": "false", 2024-09-22T03:03:16.814 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_older_version_delay": "604800", 2024-09-22T03:03:16.814 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_misplaced": "false", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_older_version": "true", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-22T03:03:16.815 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "monmap": "", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "motr_tracing_enabled": "false", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_op_threads": "3", 2024-09-22T03:03:16.816 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_cm": "false", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_device_name": "", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_dscp": "96", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_local_gid": "", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_port_num": "1", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_sl": "3", 2024-09-22T03:03:16.817 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_support_srq": "true", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_rdma_type": "ib", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_async_reap_threshold": "5", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_bind_before_connect": "false", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_bind_ipv4": "true", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_bind_ipv6": "false", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_bind_msgr1": "true", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_bind_msgr2": "true", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_bind_port_max": "7568", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_bind_port_min": "6800", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_bind_retry_count": "3", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_bind_retry_delay": "5", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_blackhole_client": "false", 2024-09-22T03:03:16.818 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_blackhole_mds": "false", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_blackhole_mgr": "false", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_blackhole_mon": "false", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_blackhole_osd": "false", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_client_mode": "crc", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_cluster_mode": "crc", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_cluster_type": "", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_compress_secure": "false", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_connection_idle_timeout": "900", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_connection_ready_timeout": "10", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_crc_data": "true", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_crc_header": "true", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_die_on_bad_msg": "false", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_die_on_bug": "true", 2024-09-22T03:03:16.819 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_die_on_old_message": "true", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_die_on_skipped_message": "false", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_coremask": "0xF", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_enable_tso": "true", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_hugepages": "", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_lro": "true", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_memory_channel": "4", 2024-09-22T03:03:16.820 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_pmd": "", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_port_id": "0", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_dump_on_send": "false", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_initial_backoff": "0.200000", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_inject_delay_max": "1.000000", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_inject_delay_type": "", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_inject_network_congestion": "0", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_inject_socket_failures": "0", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_learn_addr_from_peer": "true", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_max_accept_failures": "4", 2024-09-22T03:03:16.821 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_max_backoff": "15.000000", 2024-09-22T03:03:16.822 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_mon_client_mode": "crc", 2024-09-22T03:03:16.822 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_mon_cluster_mode": "crc", 2024-09-22T03:03:16.822 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_mon_service_mode": "crc", 2024-09-22T03:03:16.822 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_osd_compress_min_size": "1024", 2024-09-22T03:03:16.822 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_osd_compress_mode": "none", 2024-09-22T03:03:16.822 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-22T03:03:16.822 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-22T03:03:16.822 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_pq_min_cost": "65536", 2024-09-22T03:03:16.822 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_public_type": "", 2024-09-22T03:03:16.822 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_service_mode": "crc", 2024-09-22T03:03:16.822 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_tcp_listen_backlog": "512", 2024-09-22T03:03:16.822 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_tcp_nodelay": "true", 2024-09-22T03:03:16.822 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_tcp_rcvbuf": "0", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "ms_type": "async+posix", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "no_config_file": "false", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter_completion_locks_per_session": "32", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter_inflight_ops": "1024", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter_tick_interval": "5.000000", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "objecter_timeout": "10.000000", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "objectstore_blackhole": "false", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-22T03:03:16.823 INFO:teuthology.orchestra.run.smithi145.stdout: "openssl_engine_opts": "", 2024-09-22T03:03:16.824 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_agent_delay_time": "5.000000", 2024-09-22T03:03:16.824 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_agent_hist_halflife": "1000", 2024-09-22T03:03:16.824 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_agent_max_low_ops": "2", 2024-09-22T03:03:16.824 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_agent_max_ops": "4", 2024-09-22T03:03:16.824 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-22T03:03:16.824 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-22T03:03:16.824 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_agent_slop": "0.020000", 2024-09-22T03:03:16.824 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-22T03:03:16.824 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-22T03:03:16.824 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_asio_thread_count": "2", 2024-09-22T03:03:16.824 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_async_recovery_min_cost": "100", 2024-09-22T03:03:16.824 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-22T03:03:16.825 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-22T03:03:16.825 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_backfill_scan_max": "512", 2024-09-22T03:03:16.825 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_backfill_scan_min": "64", 2024-09-22T03:03:16.825 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_backoff_on_degraded": "false", 2024-09-22T03:03:16.825 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_backoff_on_peering": "false", 2024-09-22T03:03:16.825 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_backoff_on_unfound": "true", 2024-09-22T03:03:16.825 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_beacon_report_interval": "300", 2024-09-22T03:03:16.825 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bench_duration": "30", 2024-09-22T03:03:16.825 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-22T03:03:16.825 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bench_max_block_size": "67108864", 2024-09-22T03:03:16.825 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-22T03:03:16.825 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_blkin_trace_all": "false", 2024-09-22T03:03:16.825 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-22T03:03:16.826 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-22T03:03:16.826 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-22T03:03:16.826 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-22T03:03:16.826 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_check_for_log_corruption": "false", 2024-09-22T03:03:16.826 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-22T03:03:16.826 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-22T03:03:16.826 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-09-22T03:03:16.826 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-22T03:03:16.826 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_class_update_on_start": "true", 2024-09-22T03:03:16.826 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_client_message_cap": "256", 2024-09-22T03:03:16.826 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_client_message_size_cap": "524288000", 2024-09-22T03:03:16.826 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_client_op_priority": "63", 2024-09-22T03:03:16.826 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_client_watch_timeout": "30", 2024-09-22T03:03:16.827 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_command_max_records": "256", 2024-09-22T03:03:16.827 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_compact_on_start": "false", 2024-09-22T03:03:16.827 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-22T03:03:16.827 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-22T03:03:16.827 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-22T03:03:16.827 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_crush_update_on_start": "true", 2024-09-22T03:03:16.827 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_crush_update_weight_set": "true", 2024-09-22T03:03:16.827 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-22T03:03:16.827 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-22T03:03:16.827 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-22T03:03:16.827 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-22T03:03:16.827 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-22T03:03:16.827 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_feed_pullee": "-1", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_misdirected_ops": "false", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_no_acting_change": "false", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_no_purge_strays": "false", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_op_order": "false", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_shutdown": "false", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-22T03:03:16.828 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_trim_objects": "false", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_verify_snaps": "false", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_deep_scrub_keys": "1024", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_deep_scrub_stride": "524288", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-22T03:03:16.829 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_default_notify_timeout": "30", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_delete_sleep": "0.000000", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_discard_disconnected_ops": "true", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_enable_op_tracker": "true", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_fast_info": "true", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_fast_shutdown": "true", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-22T03:03:16.830 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-22T03:03:16.831 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-22T03:03:16.831 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-22T03:03:16.831 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-22T03:03:16.831 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_function_tracing": "false", 2024-09-22T03:03:16.831 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_heartbeat_grace": "20", 2024-09-22T03:03:16.831 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_heartbeat_interval": "6", 2024-09-22T03:03:16.831 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-22T03:03:16.831 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_heartbeat_min_peers": "10", 2024-09-22T03:03:16.831 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_heartbeat_min_size": "2000", 2024-09-22T03:03:16.831 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_heartbeat_stale": "600", 2024-09-22T03:03:16.831 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-22T03:03:16.831 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_hit_set_max_size": "100000", 2024-09-22T03:03:16.831 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_hit_set_min_size": "1000", 2024-09-22T03:03:16.832 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-22T03:03:16.832 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-22T03:03:16.832 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-22T03:03:16.832 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-22T03:03:16.832 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-22T03:03:16.832 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-22T03:03:16.832 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_journal_size": "5120", 2024-09-22T03:03:16.832 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_kill_backfill_at": "0", 2024-09-22T03:03:16.832 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-22T03:03:16.832 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_map_cache_size": "50", 2024-09-22T03:03:16.832 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_map_dedup": "true", 2024-09-22T03:03:16.832 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_map_message_max": "40", 2024-09-22T03:03:16.832 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_map_share_max_epochs": "40", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_attr_name_len": "100", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_attr_size": "0", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_backfills": "1", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_markdown_count": "5", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_markdown_period": "600", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_object_name_len": "2048", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_object_namespace_len": "256", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_object_size": "134217728", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_pg_blocked_by": "16", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_pg_log_entries": "10000", 2024-09-22T03:03:16.833 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-22T03:03:16.834 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_pgls": "1024", 2024-09-22T03:03:16.834 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_push_cost": "8388608", 2024-09-22T03:03:16.834 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_push_objects": "10", 2024-09-22T03:03:16.834 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_scrubs": "3", 2024-09-22T03:03:16.834 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-22T03:03:16.834 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_trimming_pgs": "2", 2024-09-22T03:03:16.834 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_write_op_reply_len": "64", 2024-09-22T03:03:16.834 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_max_write_size": "90", 2024-09-22T03:03:16.834 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-22T03:03:16.834 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-22T03:03:16.834 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-22T03:03:16.834 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-22T03:03:16.835 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-22T03:03:16.835 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-22T03:03:16.835 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-22T03:03:16.835 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-22T03:03:16.835 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_profile": "balanced", 2024-09-22T03:03:16.835 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-22T03:03:16.835 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-22T03:03:16.835 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-22T03:03:16.835 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-22T03:03:16.835 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-22T03:03:16.835 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_memory_base": "805306368", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_memory_cache_min": "134217728", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_memory_target": "4294967296", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_memory_target_autotune": "false", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_min_pg_log_entries": "250", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_min_recovery_priority": "0", 2024-09-22T03:03:16.836 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mon_report_interval": "5", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_num_cache_shards": "32", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_num_op_tracker_shard": "32", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_numa_auto_affinity": "true", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_numa_node": "-1", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_numa_prefer_iface": "true", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_objecter_finishers": "1", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_objectstore": "bluestore", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_objectstore_fuse": "false", 2024-09-22T03:03:16.837 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_objectstore_tracing": "false", 2024-09-22T03:03:16.838 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_complaint_time": "30.000000", 2024-09-22T03:03:16.838 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_history_duration": "600", 2024-09-22T03:03:16.838 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_history_size": "20", 2024-09-22T03:03:16.838 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_history_slow_op_size": "20", 2024-09-22T03:03:16.838 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-22T03:03:16.838 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_log_threshold": "5", 2024-09-22T03:03:16.838 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_num_shards": "0", 2024-09-22T03:03:16.838 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_num_shards_hdd": "5", 2024-09-22T03:03:16.838 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_num_shards_ssd": "8", 2024-09-22T03:03:16.838 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-22T03:03:16.838 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-22T03:03:16.838 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-22T03:03:16.838 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-22T03:03:16.839 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_pq_min_cost": "65536", 2024-09-22T03:03:16.839 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-22T03:03:16.839 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_queue_cut_off": "high", 2024-09-22T03:03:16.839 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-22T03:03:16.839 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_op_thread_timeout": "15", 2024-09-22T03:03:16.839 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_open_classes_on_start": "true", 2024-09-22T03:03:16.839 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_os_flags": "0", 2024-09-22T03:03:16.839 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_peering_op_priority": "255", 2024-09-22T03:03:16.839 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pg_delete_cost": "1048576", 2024-09-22T03:03:16.839 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pg_delete_priority": "5", 2024-09-22T03:03:16.839 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-22T03:03:16.840 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-22T03:03:16.840 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-22T03:03:16.840 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pg_log_trim_max": "10000", 2024-09-22T03:03:16.840 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pg_log_trim_min": "100", 2024-09-22T03:03:16.840 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-22T03:03:16.840 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-22T03:03:16.840 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-22T03:03:16.841 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-22T03:03:16.841 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-22T03:03:16.841 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-22T03:03:16.841 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-22T03:03:16.841 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-22T03:03:16.841 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-22T03:03:16.841 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-22T03:03:16.841 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_crimson": "true", 2024-09-22T03:03:16.841 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-22T03:03:16.842 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-22T03:03:16.842 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-22T03:03:16.842 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-22T03:03:16.842 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-22T03:03:16.842 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-22T03:03:16.842 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-22T03:03:16.842 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-22T03:03:16.842 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_flags": "0", 2024-09-22T03:03:16.843 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-22T03:03:16.843 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_min_size": "2", 2024-09-22T03:03:16.843 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-22T03:03:16.843 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_pg_num": "32", 2024-09-22T03:03:16.843 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_pgp_num": "0", 2024-09-22T03:03:16.843 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-22T03:03:16.843 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_read_ratio": "70", 2024-09-22T03:03:16.843 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_size": "3", 2024-09-22T03:03:16.843 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_default_type": "replicated", 2024-09-22T03:03:16.843 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-22T03:03:16.843 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-22T03:03:16.844 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_push_per_object_cost": "1000", 2024-09-22T03:03:16.844 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-22T03:03:16.844 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recover_clone_overlap": "true", 2024-09-22T03:03:16.844 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-22T03:03:16.844 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_cost": "20971520", 2024-09-22T03:03:16.844 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-22T03:03:16.844 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_max_active": "0", 2024-09-22T03:03:16.844 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-22T03:03:16.844 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-22T03:03:16.844 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-22T03:03:16.844 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-22T03:03:16.844 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_max_single_start": "1", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_op_priority": "3", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_priority": "5", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_sleep": "0.000000", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_repair_during_recovery": "false", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_requested_scrub_priority": "120", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_auto_repair": "false", 2024-09-22T03:03:16.845 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_begin_hour": "0", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_begin_week_day": "0", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_chunk_max": "25", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_chunk_min": "5", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_cost": "52428800", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_during_recovery": "false", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_end_hour": "0", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_end_week_day": "0", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_event_cost": "4096", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-22T03:03:16.846 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_invalid_stats": "true", 2024-09-22T03:03:16.847 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-22T03:03:16.847 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-22T03:03:16.847 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_max_preemptions": "5", 2024-09-22T03:03:16.847 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-22T03:03:16.847 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_priority": "5", 2024-09-22T03:03:16.847 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_scrub_sleep": "0.000000", 2024-09-22T03:03:16.847 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-22T03:03:16.847 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-22T03:03:16.847 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-22T03:03:16.847 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_skip_data_digest": "false", 2024-09-22T03:03:16.847 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_smart_report_timeout": "5", 2024-09-22T03:03:16.847 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_snap_trim_cost": "1048576", 2024-09-22T03:03:16.847 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_snap_trim_priority": "5", 2024-09-22T03:03:16.848 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-22T03:03:16.848 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-22T03:03:16.848 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-22T03:03:16.848 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-22T03:03:16.848 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-22T03:03:16.848 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-22T03:03:16.848 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-22T03:03:16.848 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_target_transaction_size": "30", 2024-09-22T03:03:16.848 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-22T03:03:16.848 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-22T03:03:16.848 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-22T03:03:16.849 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-22T03:03:16.849 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-22T03:03:16.849 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-22T03:03:16.849 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-22T03:03:16.849 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-22T03:03:16.849 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-22T03:03:16.850 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-22T03:03:16.850 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_tracing": "false", 2024-09-22T03:03:16.850 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_use_stale_snap": "false", 2024-09-22T03:03:16.850 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-22T03:03:16.850 INFO:teuthology.orchestra.run.smithi145.stdout: "osdc_blkin_trace_all": "false", 2024-09-22T03:03:16.850 INFO:teuthology.orchestra.run.smithi145.stdout: "paxos_kill_at": "0", 2024-09-22T03:03:16.850 INFO:teuthology.orchestra.run.smithi145.stdout: "paxos_max_join_drift": "10", 2024-09-22T03:03:16.850 INFO:teuthology.orchestra.run.smithi145.stdout: "paxos_min": "500", 2024-09-22T03:03:16.850 INFO:teuthology.orchestra.run.smithi145.stdout: "paxos_min_wait": "0.050000", 2024-09-22T03:03:16.850 INFO:teuthology.orchestra.run.smithi145.stdout: "paxos_propose_interval": "1.000000", 2024-09-22T03:03:16.850 INFO:teuthology.orchestra.run.smithi145.stdout: "paxos_service_trim_max": "500", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "paxos_service_trim_min": "10", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "paxos_stash_full_interval": "25", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "paxos_trim_max": "500", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "paxos_trim_min": "250", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "perf": "true", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "public_addr": "-", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "public_addrv": "", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "public_bind_addr": "-", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "public_network": "", 2024-09-22T03:03:16.851 INFO:teuthology.orchestra.run.smithi145.stdout: "public_network_interface": "", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "qat_compressor_busy_polling": "false", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "qat_compressor_enabled": "false", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "qat_compressor_session_max_number": "256", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "rados_mon_op_timeout": "0", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "rados_osd_op_timeout": "0", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "rados_tracing": "false", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_atime_update_interval": "60", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_balance_parent_reads": "false", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_balance_snap_reads": "false", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_blkin_trace_all": "false", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-22T03:03:16.852 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_cache": "true", 2024-09-22T03:03:16.853 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-22T03:03:16.853 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-22T03:03:16.853 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-22T03:03:16.853 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-22T03:03:16.853 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_cache_policy": "writearound", 2024-09-22T03:03:16.853 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_cache_size": "33554432", 2024-09-22T03:03:16.853 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-22T03:03:16.853 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-22T03:03:16.853 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_clone_copy_on_read": "false", 2024-09-22T03:03:16.853 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_compression_hint": "none", 2024-09-22T03:03:16.853 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_concurrent_management_ops": "10", 2024-09-22T03:03:16.853 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-22T03:03:16.853 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_default_clone_format": "auto", 2024-09-22T03:03:16.854 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_default_data_pool": "", 2024-09-22T03:03:16.854 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_default_features": "61", 2024-09-22T03:03:16.854 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_default_format": "2", 2024-09-22T03:03:16.854 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_default_map_options": "", 2024-09-22T03:03:16.854 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_default_order": "22", 2024-09-22T03:03:16.854 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_default_pool": "rbd", 2024-09-22T03:03:16.854 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-22T03:03:16.854 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_default_stripe_count": "0", 2024-09-22T03:03:16.854 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_default_stripe_unit": "0", 2024-09-22T03:03:16.854 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-22T03:03:16.854 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-22T03:03:16.854 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_enable_alloc_hint": "true", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_io_scheduler": "simple", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_journal_order": "24", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_journal_pool": "", 2024-09-22T03:03:16.855 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_journal_splay_width": "4", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_localize_parent_reads": "false", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_localize_snap_reads": "false", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-22T03:03:16.856 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-22T03:03:16.857 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-22T03:03:16.857 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-22T03:03:16.857 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-22T03:03:16.857 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-22T03:03:16.857 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-22T03:03:16.857 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-22T03:03:16.857 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-22T03:03:16.857 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-22T03:03:16.857 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-22T03:03:16.857 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-22T03:03:16.857 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-22T03:03:16.857 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-22T03:03:16.857 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-22T03:03:16.858 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-22T03:03:16.858 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-22T03:03:16.858 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-22T03:03:16.858 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-22T03:03:16.858 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-22T03:03:16.858 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_mtime_update_interval": "60", 2024-09-22T03:03:16.858 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_non_blocking_aio": "true", 2024-09-22T03:03:16.858 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_op_thread_timeout": "60", 2024-09-22T03:03:16.858 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_op_threads": "1", 2024-09-22T03:03:16.858 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_parent_cache_enabled": "false", 2024-09-22T03:03:16.858 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-22T03:03:16.858 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-22T03:03:16.858 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_plugins": "", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_bps_burst": "0", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_bps_limit": "0", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_exclude_ops": "0", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_iops_burst": "0", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_iops_limit": "0", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-22T03:03:16.859 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-22T03:03:16.860 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-22T03:03:16.860 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-22T03:03:16.860 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-22T03:03:16.860 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-22T03:03:16.860 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-22T03:03:16.860 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-22T03:03:16.860 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-22T03:03:16.860 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-22T03:03:16.860 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_read_from_replica_policy": "default", 2024-09-22T03:03:16.860 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-22T03:03:16.860 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-22T03:03:16.860 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-22T03:03:16.860 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_skip_partial_discard": "true", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_tracing": "false", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_validate_names": "true", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rbd_validate_pool": "true", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "restapi_base_url": "", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "restapi_log_level": "", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_acl_grants_max_num": "100", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_admin_entry": "admin", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_backend_store": "rados", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_barbican_url": "", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_beast_enable_async": "true", 2024-09-22T03:03:16.861 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_bucket_counters_cache": "false", 2024-09-22T03:03:16.862 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-22T03:03:16.862 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-22T03:03:16.862 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-22T03:03:16.862 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-22T03:03:16.862 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-22T03:03:16.862 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-22T03:03:16.862 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-22T03:03:16.862 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-22T03:03:16.862 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_cache_enabled": "true", 2024-09-22T03:03:16.862 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_cache_expiry_interval": "900", 2024-09-22T03:03:16.862 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_cache_lru_size": "25000", 2024-09-22T03:03:16.862 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_config_store": "rados", 2024-09-22T03:03:16.862 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_content_length_compat": "false", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_copy_obj_progress": "true", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_cors_rules_max_num": "100", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_cross_domain_policy": "", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_kmip_addr": "", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_kmip_password": "", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_kmip_username": "", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_require_ssl": "true", 2024-09-22T03:03:16.863 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-22T03:03:16.864 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-22T03:03:16.864 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-22T03:03:16.864 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-22T03:03:16.864 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-22T03:03:16.864 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-22T03:03:16.864 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-22T03:03:16.864 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-22T03:03:16.864 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-22T03:03:16.864 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-22T03:03:16.864 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-22T03:03:16.864 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-22T03:03:16.864 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-22T03:03:16.864 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_vault_addr": "", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_vault_auth": "token", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_vault_namespace": "", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_vault_prefix": "", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_vault_token_file": "", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_curl_buffersize": "524288", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_curl_low_speed_time": "300", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-22T03:03:16.865 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-22T03:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-22T03:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-22T03:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-22T03:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-22T03:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-22T03:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-22T03:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-22T03:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-22T03:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-22T03:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_d4n_port": "6379", 2024-09-22T03:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-22T03:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_data_log_changes_size": "1000", 2024-09-22T03:03:16.866 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_data_log_num_shards": "128", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_data_log_window": "30", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-22T03:03:16.867 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dns_name": "", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dns_s3website_name": "", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_dynamic_resharding": "true", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-22T03:03:16.868 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_enable_gc_threads": "true", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_enable_lc_threads": "true", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_enable_ops_log": "false", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_enable_quota_threads": "true", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_enable_static_website": "false", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_enable_usage_log": "false", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_enforce_swift_acls": "true", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_exit_timeout_secs": "120", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_expose_bucket": "false", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_extended_http_attrs": "", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_filter": "none", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_frontends": "beast port=7480", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_gc_max_deferred": "50", 2024-09-22T03:03:16.869 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_gc_max_objs": "32", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_gc_processor_period": "3600", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_init_timeout": "300", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_kafka_connection_idle": "300", 2024-09-22T03:03:16.870 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_admin_domain": "", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_admin_password": "", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_admin_password_path": "", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_admin_project": "", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_admin_tenant": "", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_admin_token": "", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_admin_token_path": "", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_admin_user": "", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_api_version": "2", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_barbican_domain": "", 2024-09-22T03:03:16.871 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_barbican_password": "", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_barbican_project": "", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_barbican_user": "", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_url": "", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_lc_debug_interval": "-1", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_lc_lock_max_time": "90", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_lc_max_objs": "32", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_lc_max_rules": "1000", 2024-09-22T03:03:16.872 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_lc_max_worker": "3", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_lc_thread_delay": "0", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_ldap_dnattr": "uid", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_ldap_searchfilter": "", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_ldap_uri": "", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_log_http_headers": "", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-22T03:03:16.873 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_log_object_name_utc": "false", 2024-09-22T03:03:16.874 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-22T03:03:16.874 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-22T03:03:16.874 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_max_attr_name_len": "0", 2024-09-22T03:03:16.874 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_max_attr_size": "0", 2024-09-22T03:03:16.874 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-22T03:03:16.874 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_max_chunk_size": "4194304", 2024-09-22T03:03:16.874 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-22T03:03:16.874 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-22T03:03:16.874 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-22T03:03:16.874 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_max_listing_results": "1000", 2024-09-22T03:03:16.874 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_max_notify_retries": "10", 2024-09-22T03:03:16.874 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_max_put_param_size": "1048576", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_max_put_size": "5368709120", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_max_slo_entries": "1000", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_md_log_max_shards": "64", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_mp_lock_max_time": "600", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-22T03:03:16.875 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_nfs_max_gc": "300", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_num_async_rados_threads": "32", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_num_control_oids": "8", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_numa_node": "-1", 2024-09-22T03:03:16.876 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-22T03:03:16.877 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-22T03:03:16.877 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_objexp_chunk_size": "100", 2024-09-22T03:03:16.877 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_objexp_gc_interval": "600", 2024-09-22T03:03:16.877 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-22T03:03:16.877 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-22T03:03:16.877 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-22T03:03:16.877 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_op_thread_timeout": "600", 2024-09-22T03:03:16.877 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_op_tracing": "false", 2024-09-22T03:03:16.877 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_opa_token": "", 2024-09-22T03:03:16.877 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_opa_url": "", 2024-09-22T03:03:16.877 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_opa_verify_ssl": "true", 2024-09-22T03:03:16.878 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-22T03:03:16.878 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-22T03:03:16.878 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_ops_log_rados": "false", 2024-09-22T03:03:16.878 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_ops_log_socket_path": "", 2024-09-22T03:03:16.878 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-22T03:03:16.878 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-22T03:03:16.878 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-22T03:03:16.878 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_period_push_interval": "2.000000", 2024-09-22T03:03:16.879 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-22T03:03:16.879 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-22T03:03:16.879 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-22T03:03:16.879 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-22T03:03:16.879 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_posix_cache_lanes": "3", 2024-09-22T03:03:16.879 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-22T03:03:16.879 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-22T03:03:16.879 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_posix_cache_partitions": "3", 2024-09-22T03:03:16.879 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-22T03:03:16.879 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_print_continue": "true", 2024-09-22T03:03:16.879 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-22T03:03:16.879 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-22T03:03:16.880 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-22T03:03:16.880 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-22T03:03:16.880 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-22T03:03:16.880 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_rados_tracing": "false", 2024-09-22T03:03:16.880 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_realm": "", 2024-09-22T03:03:16.880 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_realm_id": "", 2024-09-22T03:03:16.880 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-22T03:03:16.880 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_region": "", 2024-09-22T03:03:16.880 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-22T03:03:16.880 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_request_uri": "", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_reshard_batch_size": "64", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_reshard_max_aio": "128", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_reshard_num_logs": "16", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_reshard_thread_interval": "600", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_resolve_cname": "false", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_run_sync_thread": "true", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-22T03:03:16.881 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-22T03:03:16.882 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-22T03:03:16.882 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-22T03:03:16.882 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-22T03:03:16.882 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-22T03:03:16.882 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-22T03:03:16.882 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_scheduler_type": "throttler", 2024-09-22T03:03:16.882 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_script_uri": "", 2024-09-22T03:03:16.882 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_service_provider_name": "", 2024-09-22T03:03:16.882 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-22T03:03:16.882 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sts_client_id": "", 2024-09-22T03:03:16.882 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sts_client_secret": "", 2024-09-22T03:03:16.882 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sts_entry": "sts", 2024-09-22T03:03:16.882 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sts_key": "sts", 2024-09-22T03:03:16.883 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-22T03:03:16.883 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sts_min_session_duration": "900", 2024-09-22T03:03:16.883 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sts_token_introspection_url": "", 2024-09-22T03:03:16.883 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_swift_account_in_url": "false", 2024-09-22T03:03:16.883 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_swift_auth_entry": "auth", 2024-09-22T03:03:16.883 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_swift_auth_url": "", 2024-09-22T03:03:16.883 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_swift_custom_header": "", 2024-09-22T03:03:16.883 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-22T03:03:16.883 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_swift_need_stats": "true", 2024-09-22T03:03:16.883 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_swift_tenant_name": "", 2024-09-22T03:03:16.883 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_swift_token_expiration": "86400", 2024-09-22T03:03:16.883 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_swift_url": "", 2024-09-22T03:03:16.883 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_swift_url_prefix": "swift", 2024-09-22T03:03:16.884 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-22T03:03:16.884 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-22T03:03:16.884 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-22T03:03:16.884 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sync_lease_period": "120", 2024-09-22T03:03:16.884 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-22T03:03:16.884 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-22T03:03:16.884 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-22T03:03:16.884 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-22T03:03:16.884 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-22T03:03:16.884 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-22T03:03:16.884 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-22T03:03:16.884 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-22T03:03:16.884 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-22T03:03:16.885 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_thread_pool_size": "512", 2024-09-22T03:03:16.885 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-22T03:03:16.885 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-22T03:03:16.885 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-22T03:03:16.885 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-22T03:03:16.885 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_torrent_comment": "", 2024-09-22T03:03:16.885 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_torrent_createby": "", 2024-09-22T03:03:16.885 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_torrent_encoding": "", 2024-09-22T03:03:16.885 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_torrent_flag": "false", 2024-09-22T03:03:16.885 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-22T03:03:16.885 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_torrent_origin": "", 2024-09-22T03:03:16.885 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-22T03:03:16.885 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_torrent_tracker": "", 2024-09-22T03:03:16.886 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_trust_forwarded_https": "false", 2024-09-22T03:03:16.886 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-22T03:03:16.886 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-22T03:03:16.886 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_usage_max_shards": "32", 2024-09-22T03:03:16.886 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_usage_max_user_shards": "1", 2024-09-22T03:03:16.886 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_use_opa_authz": "false", 2024-09-22T03:03:16.886 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_user_counters_cache": "false", 2024-09-22T03:03:16.886 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-22T03:03:16.886 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-22T03:03:16.886 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-22T03:03:16.886 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_user_max_buckets": "1000", 2024-09-22T03:03:16.886 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_user_policies_max_num": "100", 2024-09-22T03:03:16.887 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-22T03:03:16.887 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-22T03:03:16.887 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-22T03:03:16.887 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-22T03:03:16.887 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_user_unique_email": "true", 2024-09-22T03:03:16.887 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_verify_ssl": "true", 2024-09-22T03:03:16.887 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-22T03:03:16.887 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_zone": "", 2024-09-22T03:03:16.887 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_zone_id": "", 2024-09-22T03:03:16.887 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-22T03:03:16.887 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_zonegroup": "", 2024-09-22T03:03:16.887 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_zonegroup_id": "", 2024-09-22T03:03:16.887 INFO:teuthology.orchestra.run.smithi145.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-22T03:03:16.888 INFO:teuthology.orchestra.run.smithi145.stdout: "rgwlc_auto_session_clear": "true", 2024-09-22T03:03:16.888 INFO:teuthology.orchestra.run.smithi145.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-22T03:03:16.888 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_block_size": "4096", 2024-09-22T03:03:16.888 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-22T03:03:16.888 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-22T03:03:16.888 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-22T03:03:16.888 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-22T03:03:16.888 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-22T03:03:16.888 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_cache_size": "536870912", 2024-09-22T03:03:16.888 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-22T03:03:16.888 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-22T03:03:16.888 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-22T03:03:16.888 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_index_type": "binary_search", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_partition_filters": "false", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_perf": "false", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "run_dir": "/var/run/ceph", 2024-09-22T03:03:16.889 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_block_create": "true", 2024-09-22T03:03:16.890 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_cache_lru_size": "67108864", 2024-09-22T03:03:16.890 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-22T03:03:16.890 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-22T03:03:16.890 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_default_max_object_size": "16777216", 2024-09-22T03:03:16.890 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-22T03:03:16.890 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_device_size": "53687091200", 2024-09-22T03:03:16.890 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-22T03:03:16.890 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_full_integrity_check": "false", 2024-09-22T03:03:16.890 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_journal_batch_capacity": "16", 2024-09-22T03:03:16.890 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-22T03:03:16.890 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-22T03:03:16.890 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-22T03:03:16.890 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_main_device_type": "SSD", 2024-09-22T03:03:16.891 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-22T03:03:16.891 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-22T03:03:16.891 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-22T03:03:16.891 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-22T03:03:16.891 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-22T03:03:16.891 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-22T03:03:16.891 INFO:teuthology.orchestra.run.smithi145.stdout: "seastore_segment_size": "67108864", 2024-09-22T03:03:16.891 INFO:teuthology.orchestra.run.smithi145.stdout: "set_keepcaps": "false", 2024-09-22T03:03:16.891 INFO:teuthology.orchestra.run.smithi145.stdout: "setgroup": "", 2024-09-22T03:03:16.891 INFO:teuthology.orchestra.run.smithi145.stdout: "setuser": "", 2024-09-22T03:03:16.891 INFO:teuthology.orchestra.run.smithi145.stdout: "setuser_match_path": "", 2024-09-22T03:03:16.891 INFO:teuthology.orchestra.run.smithi145.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-22T03:03:16.892 INFO:teuthology.orchestra.run.smithi145.stdout: "thp": "false", 2024-09-22T03:03:16.892 INFO:teuthology.orchestra.run.smithi145.stdout: "threadpool_default_timeout": "60", 2024-09-22T03:03:16.892 INFO:teuthology.orchestra.run.smithi145.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-22T03:03:16.892 INFO:teuthology.orchestra.run.smithi145.stdout: "throttler_perf_counter": "true" 2024-09-22T03:03:16.892 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-22T03:03:16.894 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-22T03:03:16.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:16.993+0000 7efff4a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:16.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:16.997+0000 7efff4a6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:17.011 INFO:teuthology.orchestra.run.smithi145.stdout:{} 2024-09-22T03:03:17.012 INFO:teuthology.orchestra.run.smithi145.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-22T03:03:17.022 DEBUG:teuthology.orchestra.run.smithi145:> type ceph-objectstore-tool 2024-09-22T03:03:17.036 INFO:teuthology.orchestra.run.smithi145.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-22T03:03:17.036 DEBUG:teuthology.orchestra.run.smithi194:> type ceph-objectstore-tool 2024-09-22T03:03:17.054 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-22T03:03:17.055 INFO:teuthology.run_tasks:Running task radosbench... 2024-09-22T03:03:17.070 INFO:tasks.radosbench:Beginning radosbench... 2024-09-22T03:03:17.070 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-09-22T03:03:17.070 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-09-22T03:03:17.071 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-22T03:03:17.071 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:03:17.071 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:03:17.071 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:03:17.071 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:03:17.071 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-22T03:03:17.071 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:03:17.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:17.181+0000 7fa80b597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:17.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:17.186+0000 7fa80b597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:17.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:17.181+0000 7f6856197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:17.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:17.181+0000 7fdbd2757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:17.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:17.190+0000 7f6856197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:17.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:17.192+0000 7fdbd2757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:17.208 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:03:17.208 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:03:17.208 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:03:17.208 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:03:17.208 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:03:17.208 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:03:17.208 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:03:17.208 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:03:17.208 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:03:17.208 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:03:17.209 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:03:17.209 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:03:17.211 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:03:17.212 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:03:17.212 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:03:17.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:17.321+0000 7fc66fed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:17.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:17.329+0000 7fc66fed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:17.343 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:03:17.343 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:03:17.343 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:03:17.343 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:03:17.343 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:03:17.343 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:03:17.343 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:03:17.343 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:03:17.343 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:03:17.343 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:03:17.343 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:03:17.343 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:03:17.346 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:03:17.346 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:03:17.346 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:03:17.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:17.446+0000 7f3606058640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:17.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:17.453+0000 7f3606058640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:17.468 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:03:17.469 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:03:17.469 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:03:17.469 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:03:17.469 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:03:17.469 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:03:17.469 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:03:17.469 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:03:17.469 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:03:17.469 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:03:17.469 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:03:17.469 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:03:17.471 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:03:17.472 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:03:17.472 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:03:17.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:17.570+0000 7f3696b0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:17.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:17.577+0000 7f3696b0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:17.592 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:03:17.593 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:03:17.593 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:03:17.593 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:03:17.593 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:03:17.593 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:03:17.593 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:03:17.593 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:03:17.593 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:03:17.593 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:03:17.593 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:03:17.593 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:03:17.595 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:03:17.595 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:03:18.376 INFO:teuthology.orchestra.run.smithi145.stderr:pool 'unique_pool_0' created 2024-09-22T03:03:18.396 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-09-22T03:03:18.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:18.509+0000 7fc51f397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:18.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:18.521+0000 7fc51f397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:19.276 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:03:19.382 INFO:teuthology.orchestra.run.smithi145.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-09-22T03:03:19.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:19.380+0000 7fc34fe4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:19.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:19.392+0000 7fc34fe4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:20.404 DEBUG:teuthology.orchestra.run.smithi145:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 150 write' 2024-09-22T03:03:20.406 INFO:teuthology.run_tasks:Running task admin_socket... 2024-09-22T03:03:20.417 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-09-22T03:03:20.417 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-09-22T03:03:20.471 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:hints = 1 2024-09-22T03:03:20.471 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 150 seconds or 0 objects 2024-09-22T03:03:20.471 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Object prefix: benchmark_data_smithi145_30373 2024-09-22T03:03:20.472 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:03:20.472 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 0 0 0 0 0 0 - 0 2024-09-22T03:03:21.436 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'squid'} 2024-09-22T03:03:21.436 DEBUG:teuthology.orchestra.run.smithi145:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=squid' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-22T03:03:21.472 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 1 16 484 468 29.2483 29.25 0.0340986 0.0334643 2024-09-22T03:03:21.559 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:03:21.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:21.719+0000 7fbe86117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:21.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:21.728+0000 7fbe86117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:21.902 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-09-22T03:03:22.059 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-22T03:03:22.059 INFO:teuthology.orchestra.run.smithi145.stdout: "ops": [ 2024-09-22T03:03:22.059 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.059 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 731, 2024-09-22T03:03:22.059 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.21fa7f4f", 2024-09-22T03:03:22.059 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 0, 2024-09-22T03:03:22.059 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object730", 2024-09-22T03:03:22.059 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.059 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object730", 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.795759s", 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.021999533000000002, 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:22.035931+0000", 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.060 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 735, 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.6de2c69c", 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 0, 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object734", 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object734", 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.804758s", 2024-09-22T03:03:22.061 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.012999724000000001, 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:22.045479+0000", 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 716, 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.9e6d0e5", 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 1, 2024-09-22T03:03:22.062 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object715", 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object715", 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.750760s", 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.066998577000000004, 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:21.991009+0000", 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.063 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 717, 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.f3117c48", 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 1, 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object716", 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object716", 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.064 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.754759s", 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.062998661999999997, 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:21.995489+0000", 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 723, 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.3a16ab72", 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 1, 2024-09-22T03:03:22.065 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object722", 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object722", 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.771759s", 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.045999023, 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:22.012654+0000", 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.066 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 724, 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.61c60982", 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 1, 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object723", 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object723", 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.067 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.777759s", 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.039999150999999997, 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:22.017985+0000", 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 727, 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.1d441c75", 2024-09-22T03:03:22.068 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 1, 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object726", 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object726", 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.782759s", 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.034999256999999999, 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:22.023004+0000", 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.069 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.070 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.070 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.070 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.070 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.070 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 736, 2024-09-22T03:03:22.070 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.361c5505", 2024-09-22T03:03:22.070 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 1, 2024-09-22T03:03:22.070 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object735", 2024-09-22T03:03:22.070 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.070 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object735", 2024-09-22T03:03:22.070 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.070 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.070 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.071 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.071 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.806758s", 2024-09-22T03:03:22.071 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.010999767000000001, 2024-09-22T03:03:22.071 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.071 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.071 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.071 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:22.047748+0000", 2024-09-22T03:03:22.071 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.071 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.071 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.071 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.071 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.071 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 737, 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.b82c80d5", 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 1, 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object736", 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object736", 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.811758s", 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.0059998730000000002, 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.072 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:22.052276+0000", 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 738, 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.282f5f55", 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 1, 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object737", 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object737", 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.073 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.812758s", 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.0049998940000000004, 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:22.053611+0000", 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.074 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 739, 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.4ad4b9bd", 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 1, 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object738", 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object738", 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.814758s", 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.0029999369999999998, 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.075 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:22.054900+0000", 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 732, 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.33898f7e", 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 2, 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object731", 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object731", 2024-09-22T03:03:22.076 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.798759s", 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.018999597, 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:22.039536+0000", 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.077 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 733, 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.90355e76", 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 2, 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object732", 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object732", 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.801758s", 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.015999659999999999, 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.078 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:22.041913+0000", 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 715, 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.1acc7c20", 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 3, 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object714", 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object714", 2024-09-22T03:03:22.079 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.747760s", 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.069998512999999998, 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:21.988193+0000", 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.080 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 728, 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.1dbffd71", 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 3, 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object727", 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object727", 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.787759s", 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.029999363000000001, 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.081 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:22.027985+0000", 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: }, 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: { 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: "tid": 734, 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: "pg": "3.1f16afe1", 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: "osd": 3, 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: "object_id": "benchmark_data_smithi145_30373_object733", 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: "object_locator": "@3", 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_id": "benchmark_data_smithi145_30373_object733", 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: "target_object_locator": "@3", 2024-09-22T03:03:22.082 INFO:teuthology.orchestra.run.smithi145.stdout: "paused": 0, 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: "used_replica": 0, 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: "precalc_pgid": 0, 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: "last_sent": "501.803758s", 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: "age": 0.013999703, 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: "attempts": 1, 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: "snapid": "head", 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: "snap_context": "0=[]", 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: "mtime": "2024-09-22T03:03:22.044619+0000", 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: "osd_ops": [ 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: "write 0~65536 in=65536b" 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: ] 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: } 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: ], 2024-09-22T03:03:22.083 INFO:teuthology.orchestra.run.smithi145.stdout: "linger_ops": [], 2024-09-22T03:03:22.084 INFO:teuthology.orchestra.run.smithi145.stdout: "pool_ops": [], 2024-09-22T03:03:22.084 INFO:teuthology.orchestra.run.smithi145.stdout: "pool_stat_ops": [], 2024-09-22T03:03:22.084 INFO:teuthology.orchestra.run.smithi145.stdout: "statfs_ops": [], 2024-09-22T03:03:22.084 INFO:teuthology.orchestra.run.smithi145.stdout: "command_ops": [] 2024-09-22T03:03:22.084 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-22T03:03:22.085 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 731, "pg": "3.21fa7f4f", "osd": 0, "object_id": "benchmark_data_smithi145_30373_object730", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object730", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.795759s", "age": 0.021999533000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:22.035931+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 735, "pg": "3.6de2c69c", "osd": 0, "object_id": "benchmark_data_smithi145_30373_object734", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object734", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.804758s", "age": 0.012999724000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:22.045479+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 716, "pg": "3.9e6d0e5", "osd": 1, "object_id": "benchmark_data_smithi145_30373_object715", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object715", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.750760s", "age": 0.066998577000000004, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:21.991009+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 717, "pg": "3.f3117c48", "osd": 1, "object_id": "benchmark_data_smithi145_30373_object716", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object716", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.754759s", "age": 0.062998661999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:21.995489+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 723, "pg": "3.3a16ab72", "osd": 1, "object_id": "benchmark_data_smithi145_30373_object722", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object722", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.771759s", "age": 0.045999023, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:22.012654+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 724, "pg": "3.61c60982", "osd": 1, "object_id": "benchmark_data_smithi145_30373_object723", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object723", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.777759s", "age": 0.039999150999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:22.017985+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 727, "pg": "3.1d441c75", "osd": 1, "object_id": "benchmark_data_smithi145_30373_object726", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object726", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.782759s", "age": 0.034999256999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:22.023004+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 736, "pg": "3.361c5505", "osd": 1, "object_id": "benchmark_data_smithi145_30373_object735", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object735", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.806758s", "age": 0.010999767000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:22.047748+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 737, "pg": "3.b82c80d5", "osd": 1, "object_id": "benchmark_data_smithi145_30373_object736", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object736", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.811758s", "age": 0.0059998730000000002, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:22.052276+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 738, "pg": "3.282f5f55", "osd": 1, "object_id": "benchmark_data_smithi145_30373_object737", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object737", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.812758s", "age": 0.0049998940000000004, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:22.053611+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 739, "pg": "3.4ad4b9bd", "osd": 1, "object_id": "benchmark_data_smithi145_30373_object738", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object738", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.814758s", "age": 0.0029999369999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:22.054900+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 732, "pg": "3.33898f7e", "osd": 2, "object_id": "benchmark_data_smithi145_30373_object731", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object731", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.798759s", "age": 0.018999597, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:22.039536+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 733, "pg": "3.90355e76", "osd": 2, "object_id": "benchmark_data_smithi145_30373_object732", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object732", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.801758s", "age": 0.015999659999999999, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:22.041913+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 715, "pg": "3.1acc7c20", "osd": 3, "object_id": "benchmark_data_smithi145_30373_object714", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object714", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.747760s", "age": 0.069998512999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:21.988193+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 728, "pg": "3.1dbffd71", "osd": 3, "object_id": "benchmark_data_smithi145_30373_object727", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object727", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.787759s", "age": 0.029999363000000001, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:22.027985+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 734, "pg": "3.1f16afe1", "osd": 3, "object_id": "benchmark_data_smithi145_30373_object733", "object_locator": "@3", "target_object_id": "benchmark_data_smithi145_30373_object733", "target_object_locator": "@3", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "501.803758s", "age": 0.013999703, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-09-22T03:03:22.044619+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-09-22T03:03:22.085 DEBUG:teuthology.orchestra.run.smithi145:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-09-22T03:03:22.142 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-09-22T03:03:22.160 DEBUG:teuthology.parallel:result is None 2024-09-22T03:03:22.160 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-09-22T03:03:22.169 INFO:tasks.radosbench:joining radosbench (timing out after 4800s) 2024-09-22T03:03:22.169 INFO:teuthology.orchestra.run:waiting for 4800 2024-09-22T03:03:22.472 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 2 16 934 918 28.6854 28.125 0.0322714 0.0345951 2024-09-22T03:03:22.596 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:03:22.596 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:03:22.597 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:03:22.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:22.753+0000 7f1a0a2c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:22.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:22.766+0000 7f1a0a2c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:23.065 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:23.065 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:03:23.087 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-22T03:03:21.307839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":39,"acting":39,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":108020,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":107264,"kb_avail":377379340,"statfs":{"total":386547056640,"available":386436444160,"internally_reserved":0,"allocated":671744,"data_stored":1894113,"data_compressed":89886,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":109838336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001241"},"pg_stats":[{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":15,"state":"creating+peering","last_fresh":"2024-09-22T03:03:18.420739+0000","last_change":"2024-09-22T03:03:18.420739+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.420739+0000","last_undegraded":"2024-09-22T03:03:18.420739+0000","last_fullsized":"2024-09-22T03:03:18.420739+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:03:18.369514+0000","last_change":"2024-09-22T03:03:18.369514+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.369514+0000","last_undegraded":"2024-09-22T03:03:18.369514+0000","last_fullsized":"2024-09-22T03:03:18.369514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:03:18.369514+0000","last_change":"2024-09-22T03:03:18.369514+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.369514+0000","last_undegraded":"2024-09-22T03:03:18.369514+0000","last_fullsized":"2024-09-22T03:03:18.369514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":15,"state":"creating+peering","last_fresh":"2024-09-22T03:03:18.409802+0000","last_change":"2024-09-22T03:03:18.409802+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.409802+0000","last_undegraded":"2024-09-22T03:03:18.409802+0000","last_fullsized":"2024-09-22T03:03:18.409802+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:03:18.369514+0000","last_change":"2024-09-22T03:03:18.369514+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.369514+0000","last_undegraded":"2024-09-22T03:03:18.369514+0000","last_fullsized":"2024-09-22T03:03:18.369514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":15,"state":"creating+peering","last_fresh":"2024-09-22T03:03:18.401471+0000","last_change":"2024-09-22T03:03:18.401471+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.401471+0000","last_undegraded":"2024-09-22T03:03:18.401471+0000","last_fullsized":"2024-09-22T03:03:18.401471+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":15,"state":"creating+peering","last_fresh":"2024-09-22T03:03:18.393375+0000","last_change":"2024-09-22T03:03:18.393375+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.393375+0000","last_undegraded":"2024-09-22T03:03:18.393375+0000","last_fullsized":"2024-09-22T03:03:18.393375+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:03:18.369514+0000","last_change":"2024-09-22T03:03:18.369514+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.369514+0000","last_undegraded":"2024-09-22T03:03:18.369514+0000","last_fullsized":"2024-09-22T03:03:18.369514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359530+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:10.359530+0000","last_peered":"2024-09-22T03:03:10.359530+0000","last_clean":"2024-09-22T03:03:10.359530+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:10.359530+0000","last_undegraded":"2024-09-22T03:03:10.359530+0000","last_fullsized":"2024-09-22T03:03:10.359530+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:03:18.369514+0000","last_change":"2024-09-22T03:03:18.369514+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.369514+0000","last_undegraded":"2024-09-22T03:03:18.369514+0000","last_fullsized":"2024-09-22T03:03:18.369514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":19,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-22T03:03:18.387817+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:03:18.387817+0000","last_peered":"2024-09-22T03:03:18.387817+0000","last_clean":"2024-09-22T03:03:18.387817+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:03:18.387817+0000","last_undegraded":"2024-09-22T03:03:18.387817+0000","last_fullsized":"2024-09-22T03:03:18.387817+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:03:18.369514+0000","last_change":"2024-09-22T03:03:18.369514+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.369514+0000","last_undegraded":"2024-09-22T03:03:18.369514+0000","last_fullsized":"2024-09-22T03:03:18.369514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.2","version":"13'1","reported_seq":18,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362354+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:10.362354+0000","last_peered":"2024-09-22T03:03:10.362354+0000","last_clean":"2024-09-22T03:03:10.362354+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:10.362354+0000","last_undegraded":"2024-09-22T03:03:10.362354+0000","last_fullsized":"2024-09-22T03:03:10.362354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:03:18.369514+0000","last_change":"2024-09-22T03:03:18.369514+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.369514+0000","last_undegraded":"2024-09-22T03:03:18.369514+0000","last_fullsized":"2024-09-22T03:03:18.369514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":17,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362415+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:10.362415+0000","last_peered":"2024-09-22T03:03:10.362415+0000","last_clean":"2024-09-22T03:03:10.362415+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:10.362415+0000","last_undegraded":"2024-09-22T03:03:10.362415+0000","last_fullsized":"2024-09-22T03:03:10.362415+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":145,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-09-22T03:03:18.390070+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:03:18.390070+0000","last_peered":"2024-09-22T03:03:18.390070+0000","last_clean":"2024-09-22T03:03:18.390070+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:03:18.390070+0000","last_undegraded":"2024-09-22T03:03:18.390070+0000","last_fullsized":"2024-09-22T03:03:18.390070+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:03:18.369514+0000","last_change":"2024-09-22T03:03:18.369514+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.369514+0000","last_undegraded":"2024-09-22T03:03:18.369514+0000","last_fullsized":"2024-09-22T03:03:18.369514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:03:18.369514+0000","last_change":"2024-09-22T03:03:18.369514+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.369514+0000","last_undegraded":"2024-09-22T03:03:18.369514+0000","last_fullsized":"2024-09-22T03:03:18.369514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.359106+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:10.359106+0000","last_peered":"2024-09-22T03:03:10.359106+0000","last_clean":"2024-09-22T03:03:10.359106+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:10.359106+0000","last_undegraded":"2024-09-22T03:03:10.359106+0000","last_fullsized":"2024-09-22T03:03:10.359106+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:03:18.369514+0000","last_change":"2024-09-22T03:03:18.369514+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.369514+0000","last_undegraded":"2024-09-22T03:03:18.369514+0000","last_fullsized":"2024-09-22T03:03:18.369514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362742+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:10.362742+0000","last_peered":"2024-09-22T03:03:10.362742+0000","last_clean":"2024-09-22T03:03:10.362742+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:10.362742+0000","last_undegraded":"2024-09-22T03:03:10.362742+0000","last_fullsized":"2024-09-22T03:03:10.362742+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:03:18.369514+0000","last_change":"2024-09-22T03:03:18.369514+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.369514+0000","last_undegraded":"2024-09-22T03:03:18.369514+0000","last_fullsized":"2024-09-22T03:03:18.369514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362103+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:10.362103+0000","last_peered":"2024-09-22T03:03:10.362103+0000","last_clean":"2024-09-22T03:03:10.362103+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:10.362103+0000","last_undegraded":"2024-09-22T03:03:10.362103+0000","last_fullsized":"2024-09-22T03:03:10.362103+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-22T03:03:18.369514+0000","last_change":"2024-09-22T03:03:18.369514+0000","last_active":"2024-09-22T03:03:18.369514+0000","last_peered":"2024-09-22T03:03:18.369514+0000","last_clean":"2024-09-22T03:03:18.369514+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-22T03:03:18.369514+0000","last_undegraded":"2024-09-22T03:03:18.369514+0000","last_fullsized":"2024-09-22T03:03:18.369514+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":16,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-09-22T03:03:10.362046+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:10.362046+0000","last_peered":"2024-09-22T03:03:10.362046+0000","last_clean":"2024-09-22T03:03:10.362046+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:10.362046+0000","last_undegraded":"2024-09-22T03:03:10.362046+0000","last_fullsized":"2024-09-22T03:03:10.362046+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":26952,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344888,"statfs":{"total":96636764160,"available":96609165312,"internally_reserved":0,"allocated":122880,"data_stored":30757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27024,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344816,"statfs":{"total":96636764160,"available":96609091584,"internally_reserved":0,"allocated":184320,"data_stored":621125,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27020,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94344820,"statfs":{"total":96636764160,"available":96609095680,"internally_reserved":0,"allocated":180224,"data_stored":621106,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:03:23.472 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 3 16 1400 1384 28.8312 29.125 0.0214938 0.0343574 2024-09-22T03:03:23.934 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:03:24.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:24.089+0000 7f6b20f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:24.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:24.096+0000 7f6b20f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:24.472 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 4 16 1861 1845 28.8259 28.8125 0.0286728 0.034537 2024-09-22T03:03:25.472 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 5 16 2337 2321 29.0102 29.75 0.0460684 0.0342904 2024-09-22T03:03:26.368 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:03:26.472 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 6 16 2815 2799 29.154 29.875 0.0464769 0.0341659 2024-09-22T03:03:26.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:26.511+0000 7f265e658640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:26.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:26.518+0000 7f265e658640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:27.472 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 7 16 3276 3260 29.1049 28.8125 0.0514557 0.0342187 2024-09-22T03:03:28.089 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:03:28.089 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:03:28.089 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:03:28.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:28.247+0000 7f73a60d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:28.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:28.258+0000 7f73a60d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:28.472 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 8 16 3697 3681 28.7555 26.3125 0.029308 0.0346549 2024-09-22T03:03:28.547 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:28.548 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:03:28.568 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-22T03:03:27.308841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":165806643,"num_objects":2525,"num_object_clones":0,"num_object_copies":7575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":2660,"num_write_kb":163240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2605,"ondisk_log_size":2605,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":154880,"kb_used_data":26752,"kb_used_omap":0,"kb_used_meta":128064,"kb_avail":377332480,"statfs":{"total":386547056640,"available":386388459520,"internally_reserved":0,"allocated":27394048,"data_stored":427921497,"data_compressed":20314556,"data_compressed_allocated":26746880,"data_compressed_original":427704320,"omap_allocated":0,"internal_metadata":131137536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":165216256,"num_objects":2521,"num_object_clones":0,"num_object_copies":7563,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2521,"num_write_kb":161344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001305"},"pg_stats":[{"pgid":"3.f","version":"17'118","reported_seq":131,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:24.282228+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:03:24.282228+0000","last_peered":"2024-09-22T03:03:24.282228+0000","last_clean":"2024-09-22T03:03:24.282228+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:03:24.282228+0000","last_undegraded":"2024-09-22T03:03:24.282228+0000","last_fullsized":"2024-09-22T03:03:24.282228+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7798784,"num_objects":119,"num_object_clones":0,"num_object_copies":357,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":119,"num_write_kb":7616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'168","reported_seq":181,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:26.331679+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:03:26.331679+0000","last_peered":"2024-09-22T03:03:26.331679+0000","last_clean":"2024-09-22T03:03:26.331679+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:03:26.331679+0000","last_undegraded":"2024-09-22T03:03:26.331679+0000","last_fullsized":"2024-09-22T03:03:26.331679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11075584,"num_objects":169,"num_object_clones":0,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":169,"num_write_kb":10816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'173","reported_seq":186,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:26.240182+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:03:26.240182+0000","last_peered":"2024-09-22T03:03:26.240182+0000","last_clean":"2024-09-22T03:03:26.240182+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:03:26.240182+0000","last_undegraded":"2024-09-22T03:03:26.240182+0000","last_fullsized":"2024-09-22T03:03:26.240182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"17'107","reported_seq":120,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:24.287255+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:03:24.287255+0000","last_peered":"2024-09-22T03:03:24.287255+0000","last_clean":"2024-09-22T03:03:24.287255+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:03:24.287255+0000","last_undegraded":"2024-09-22T03:03:24.287255+0000","last_fullsized":"2024-09-22T03:03:24.287255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":108,"num_write_kb":6912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'173","reported_seq":186,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:26.277224+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:03:26.277224+0000","last_peered":"2024-09-22T03:03:26.277224+0000","last_clean":"2024-09-22T03:03:26.277224+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:03:26.277224+0000","last_undegraded":"2024-09-22T03:03:26.277224+0000","last_fullsized":"2024-09-22T03:03:26.277224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11403264,"num_objects":174,"num_object_clones":0,"num_object_copies":522,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":11136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"17'126","reported_seq":139,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:24.312676+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:03:24.312676+0000","last_peered":"2024-09-22T03:03:24.312676+0000","last_clean":"2024-09-22T03:03:24.312676+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:03:24.312676+0000","last_undegraded":"2024-09-22T03:03:24.312676+0000","last_fullsized":"2024-09-22T03:03:24.312676+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8323072,"num_objects":127,"num_object_clones":0,"num_object_copies":381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"17'113","reported_seq":126,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:24.274497+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:03:24.274497+0000","last_peered":"2024-09-22T03:03:24.274497+0000","last_clean":"2024-09-22T03:03:24.274497+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:03:24.274497+0000","last_undegraded":"2024-09-22T03:03:24.274497+0000","last_fullsized":"2024-09-22T03:03:24.274497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":113,"log_dups_size":0,"ondisk_log_size":113,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7471104,"num_objects":114,"num_object_clones":0,"num_object_copies":342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":7296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"17'169","reported_seq":182,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:26.243047+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:03:26.243047+0000","last_peered":"2024-09-22T03:03:26.243047+0000","last_clean":"2024-09-22T03:03:26.243047+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:03:26.243047+0000","last_undegraded":"2024-09-22T03:03:26.243047+0000","last_fullsized":"2024-09-22T03:03:26.243047+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11141120,"num_objects":170,"num_object_clones":0,"num_object_copies":510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":170,"num_write_kb":10880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.389604+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:20.389604+0000","last_peered":"2024-09-22T03:03:20.389604+0000","last_clean":"2024-09-22T03:03:20.389604+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:20.389604+0000","last_undegraded":"2024-09-22T03:03:20.389604+0000","last_fullsized":"2024-09-22T03:03:20.389604+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'189","reported_seq":202,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:26.299882+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:03:26.299882+0000","last_peered":"2024-09-22T03:03:26.299882+0000","last_clean":"2024-09-22T03:03:26.299882+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:03:26.299882+0000","last_undegraded":"2024-09-22T03:03:26.299882+0000","last_fullsized":"2024-09-22T03:03:26.299882+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12451840,"num_objects":190,"num_object_clones":0,"num_object_copies":570,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":190,"num_write_kb":12160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.394316+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:03:20.394316+0000","last_peered":"2024-09-22T03:03:20.394316+0000","last_clean":"2024-09-22T03:03:20.394316+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:03:20.394316+0000","last_undegraded":"2024-09-22T03:03:20.394316+0000","last_fullsized":"2024-09-22T03:03:20.394316+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"17'138","reported_seq":151,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:26.266998+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:03:26.266998+0000","last_peered":"2024-09-22T03:03:26.266998+0000","last_clean":"2024-09-22T03:03:26.266998+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:03:26.266998+0000","last_undegraded":"2024-09-22T03:03:26.266998+0000","last_fullsized":"2024-09-22T03:03:26.266998+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9109504,"num_objects":139,"num_object_clones":0,"num_object_copies":417,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":139,"num_write_kb":8896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.388644+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:20.388644+0000","last_peered":"2024-09-22T03:03:20.388644+0000","last_clean":"2024-09-22T03:03:20.388644+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:20.388644+0000","last_undegraded":"2024-09-22T03:03:20.388644+0000","last_fullsized":"2024-09-22T03:03:20.388644+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'185","reported_seq":198,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:26.318442+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:03:26.318442+0000","last_peered":"2024-09-22T03:03:26.318442+0000","last_clean":"2024-09-22T03:03:26.318442+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:03:26.318442+0000","last_undegraded":"2024-09-22T03:03:26.318442+0000","last_fullsized":"2024-09-22T03:03:26.318442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12189696,"num_objects":186,"num_object_clones":0,"num_object_copies":558,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":186,"num_write_kb":11904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.393994+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:20.393994+0000","last_peered":"2024-09-22T03:03:20.393994+0000","last_clean":"2024-09-22T03:03:20.393994+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:20.393994+0000","last_undegraded":"2024-09-22T03:03:20.393994+0000","last_fullsized":"2024-09-22T03:03:20.393994+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":151,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.396218+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:03:20.396218+0000","last_peered":"2024-09-22T03:03:20.396218+0000","last_clean":"2024-09-22T03:03:20.396218+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:03:20.396218+0000","last_undegraded":"2024-09-22T03:03:20.396218+0000","last_fullsized":"2024-09-22T03:03:20.396218+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"17'176","reported_seq":189,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:26.249768+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:03:26.249768+0000","last_peered":"2024-09-22T03:03:26.249768+0000","last_clean":"2024-09-22T03:03:26.249768+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:03:26.249768+0000","last_undegraded":"2024-09-22T03:03:26.249768+0000","last_fullsized":"2024-09-22T03:03:26.249768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11599872,"num_objects":177,"num_object_clones":0,"num_object_copies":531,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":11328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'152","reported_seq":165,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:26.282986+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:03:26.282986+0000","last_peered":"2024-09-22T03:03:26.282986+0000","last_clean":"2024-09-22T03:03:26.282986+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:03:26.282986+0000","last_undegraded":"2024-09-22T03:03:26.282986+0000","last_fullsized":"2024-09-22T03:03:26.282986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10027008,"num_objects":153,"num_object_clones":0,"num_object_copies":459,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392562+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:20.392562+0000","last_peered":"2024-09-22T03:03:20.392562+0000","last_clean":"2024-09-22T03:03:20.392562+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:20.392562+0000","last_undegraded":"2024-09-22T03:03:20.392562+0000","last_fullsized":"2024-09-22T03:03:20.392562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'180","reported_seq":193,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:26.273499+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:03:26.273499+0000","last_peered":"2024-09-22T03:03:26.273499+0000","last_clean":"2024-09-22T03:03:26.273499+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:03:26.273499+0000","last_undegraded":"2024-09-22T03:03:26.273499+0000","last_fullsized":"2024-09-22T03:03:26.273499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11862016,"num_objects":181,"num_object_clones":0,"num_object_copies":543,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":181,"num_write_kb":11584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392946+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:20.392946+0000","last_peered":"2024-09-22T03:03:20.392946+0000","last_clean":"2024-09-22T03:03:20.392946+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:20.392946+0000","last_undegraded":"2024-09-22T03:03:20.392946+0000","last_fullsized":"2024-09-22T03:03:20.392946+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"17'171","reported_seq":184,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:26.312781+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:03:26.312781+0000","last_peered":"2024-09-22T03:03:26.312781+0000","last_clean":"2024-09-22T03:03:26.312781+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:03:26.312781+0000","last_undegraded":"2024-09-22T03:03:26.312781+0000","last_fullsized":"2024-09-22T03:03:26.312781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11272192,"num_objects":172,"num_object_clones":0,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":172,"num_write_kb":11008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.397841+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:20.397841+0000","last_peered":"2024-09-22T03:03:20.397841+0000","last_clean":"2024-09-22T03:03:20.397841+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:20.397841+0000","last_undegraded":"2024-09-22T03:03:20.397841+0000","last_fullsized":"2024-09-22T03:03:20.397841+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"17'167","reported_seq":180,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:26.330685+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:03:26.330685+0000","last_peered":"2024-09-22T03:03:26.330685+0000","last_clean":"2024-09-22T03:03:26.330685+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:03:26.330685+0000","last_undegraded":"2024-09-22T03:03:26.330685+0000","last_fullsized":"2024-09-22T03:03:26.330685+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":167,"log_dups_size":0,"ondisk_log_size":167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11010048,"num_objects":168,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":10752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.398509+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:20.398509+0000","last_peered":"2024-09-22T03:03:20.398509+0000","last_clean":"2024-09-22T03:03:20.398509+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:20.398509+0000","last_undegraded":"2024-09-22T03:03:20.398509+0000","last_fullsized":"2024-09-22T03:03:20.398509+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":165216256,"num_objects":2521,"num_object_clones":0,"num_object_copies":7563,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2521,"num_write_kb":161344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":31191040,"data_stored":499056640,"data_compressed":23694550,"data_compressed_allocated":31191040,"data_compressed_original":499056640,"omap_allocated":0,"internal_metadata":0},"log_size":2505,"ondisk_log_size":2505,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672980,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":39064,"kb_used_data":8072,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94332776,"statfs":{"total":96636764160,"available":96596762624,"internally_reserved":0,"allocated":8265728,"data_stored":129933955,"data_compressed":6167022,"data_compressed_allocated":8118272,"data_compressed_original":129892352,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":42760,"kb_used_data":7608,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94329080,"statfs":{"total":96636764160,"available":96592977920,"internally_reserved":0,"allocated":7790592,"data_stored":121939107,"data_compressed":5789520,"data_compressed_allocated":7622656,"data_compressed_original":121880576,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":38140,"kb_used_data":7148,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94333700,"statfs":{"total":96636764160,"available":96597708800,"internally_reserved":0,"allocated":7319552,"data_stored":114402467,"data_compressed":5431550,"data_compressed_allocated":7151616,"data_compressed_original":114343936,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":34916,"kb_used_data":3924,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94336924,"statfs":{"total":96636764160,"available":96601010176,"internally_reserved":0,"allocated":4018176,"data_stored":61645968,"data_compressed":2926464,"data_compressed_allocated":3854336,"data_compressed_original":61587456,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5120000,"data_stored":81920000,"data_compressed":3889230,"data_compressed_allocated":5120000,"data_compressed_original":81920000,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8646656,"data_stored":138346496,"data_compressed":6568588,"data_compressed_allocated":8646656,"data_compressed_original":138346496,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":7598080,"data_stored":121569280,"data_compressed":5772006,"data_compressed_allocated":7598080,"data_compressed_original":121569280,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9826304,"data_stored":157220864,"data_compressed":7464726,"data_compressed_allocated":9826304,"data_compressed_original":157220864,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:03:28.710 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:03:28.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:28.867+0000 7f9c33797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:28.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:28.876+0000 7f9c33797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:29.472 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 9 16 4153 4137 28.7269 28.5 0.0354464 0.0347388 2024-09-22T03:03:30.472 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 10 16 4626 4610 28.8101 29.5625 0.0324801 0.0346431 2024-09-22T03:03:31.052 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:03:31.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:31.180+0000 7fcf79458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:31.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:31.185+0000 7fcf79458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:31.473 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 11 16 5062 5046 28.6681 27.25 0.018898 0.0348307 2024-09-22T03:03:32.473 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 12 16 5508 5492 28.6018 27.875 0.0316984 0.034914 2024-09-22T03:03:33.376 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:03:33.473 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 13 16 5961 5945 28.5794 28.3125 0.0337422 0.0349219 2024-09-22T03:03:33.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:33.528+0000 7f9bee197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:33.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:33.536+0000 7f9bee197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:33.570 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:03:33.570 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:03:33.570 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:03:33.570 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:03:33.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:33.722+0000 7f644a50e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:33.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:33.735+0000 7f644a50e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:33.768 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:03:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:03:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:03:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:03:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:03:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:03:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:03:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:03:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:03:33.769 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:03:33.770 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:03:33.770 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:03:33.773 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:03:33.773 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:03:33.773 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:03:33.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:33.924+0000 7fca8f157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:33.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:33.937+0000 7fca8f157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:34.036 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:03:34.036 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:03:34.036 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:03:34.036 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:03:34.036 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:03:34.036 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:03:34.036 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:03:34.036 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:03:34.036 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:03:34.037 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:03:34.037 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:03:34.037 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:03:34.040 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:03:34.040 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:03:34.041 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:03:34.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:34.186+0000 7f31798fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:34.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:34.201+0000 7f31798fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:34.227 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:03:34.228 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:03:34.228 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:03:34.228 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:03:34.228 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:03:34.228 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:03:34.228 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:03:34.228 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:03:34.228 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:03:34.228 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:03:34.228 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:03:34.229 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:03:34.233 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:03:34.234 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:03:34.234 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:03:34.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:34.377+0000 7f8d3f44f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:34.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:34.393+0000 7f8d3f44f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:03:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:03:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:03:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:03:34.429 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:03:34.430 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:03:34.430 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:03:34.430 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:03:34.430 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:03:34.430 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:03:34.430 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:03:34.430 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:03:34.435 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:03:34.435 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:03:34.473 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 14 16 6378 6362 28.3994 26.0625 0.0301561 0.0351607 2024-09-22T03:03:35.473 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 15 16 6819 6803 28.3435 27.5625 0.0345497 0.0352195 2024-09-22T03:03:35.846 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:03:36.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:35.997+0000 7f08f1c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:36.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:36.006+0000 7f08f1c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:36.473 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 16 16 7252 7236 28.2633 27.0625 0.0359738 0.0353233 2024-09-22T03:03:37.473 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 17 16 7699 7683 28.244 27.9375 0.0344527 0.0353684 2024-09-22T03:03:38.225 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:03:38.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:38.366+0000 7f0d0dd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:38.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:38.375+0000 7f0d0dd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:38.473 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 18 16 8131 8115 28.1748 27 0.0430079 0.0354468 2024-09-22T03:03:39.436 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:03:39.436 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:03:39.436 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:03:39.473 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 19 16 8551 8535 28.0734 26.25 0.0253405 0.0355684 2024-09-22T03:03:39.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:39.576+0000 7fe21342c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:39.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:39.589+0000 7fe21342c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:39.919 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:39.919 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:03:39.941 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-22T03:03:39.311255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":458228275,"num_objects":6987,"num_object_clones":0,"num_object_copies":20961,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":7122,"num_write_kb":448808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7067,"ondisk_log_size":7067,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":203488,"kb_used_data":79516,"kb_used_omap":0,"kb_used_meta":123904,"kb_avail":377283872,"statfs":{"total":386547056640,"available":386338684928,"internally_reserved":0,"allocated":81424384,"data_stored":1292406873,"data_compressed":61364948,"data_compressed_allocated":80777216,"data_compressed_original":1292189696,"omap_allocated":0,"internal_metadata":126877696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":292421632,"num_objects":4462,"num_object_clones":0,"num_object_copies":13386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4462,"num_write_kb":285568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002414"},"pg_stats":[{"pgid":"3.f","version":"17'388","reported_seq":401,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:34.216400+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:03:34.216400+0000","last_peered":"2024-09-22T03:03:34.216400+0000","last_clean":"2024-09-22T03:03:34.216400+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:03:34.216400+0000","last_undegraded":"2024-09-22T03:03:34.216400+0000","last_fullsized":"2024-09-22T03:03:34.216400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25493504,"num_objects":389,"num_object_clones":0,"num_object_copies":1167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":24896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'477","reported_seq":490,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:36.263553+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:03:36.263553+0000","last_peered":"2024-09-22T03:03:36.263553+0000","last_clean":"2024-09-22T03:03:36.263553+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:03:36.263553+0000","last_undegraded":"2024-09-22T03:03:36.263553+0000","last_fullsized":"2024-09-22T03:03:36.263553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31326208,"num_objects":478,"num_object_clones":0,"num_object_copies":1434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":478,"num_write_kb":30592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'434","reported_seq":447,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:36.341816+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:03:36.341816+0000","last_peered":"2024-09-22T03:03:36.341816+0000","last_clean":"2024-09-22T03:03:36.341816+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:03:36.341816+0000","last_undegraded":"2024-09-22T03:03:36.341816+0000","last_fullsized":"2024-09-22T03:03:36.341816+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28508160,"num_objects":435,"num_object_clones":0,"num_object_copies":1305,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":435,"num_write_kb":27840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"17'415","reported_seq":428,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:34.282293+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:03:34.282293+0000","last_peered":"2024-09-22T03:03:34.282293+0000","last_clean":"2024-09-22T03:03:34.282293+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:03:34.282293+0000","last_undegraded":"2024-09-22T03:03:34.282293+0000","last_fullsized":"2024-09-22T03:03:34.282293+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'439","reported_seq":452,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:36.316398+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:03:36.316398+0000","last_peered":"2024-09-22T03:03:36.316398+0000","last_clean":"2024-09-22T03:03:36.316398+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:03:36.316398+0000","last_undegraded":"2024-09-22T03:03:36.316398+0000","last_fullsized":"2024-09-22T03:03:36.316398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28835840,"num_objects":440,"num_object_clones":0,"num_object_copies":1320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":440,"num_write_kb":28160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"17'415","reported_seq":428,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:34.274885+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:03:34.274885+0000","last_peered":"2024-09-22T03:03:34.274885+0000","last_clean":"2024-09-22T03:03:34.274885+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:03:34.274885+0000","last_undegraded":"2024-09-22T03:03:34.274885+0000","last_fullsized":"2024-09-22T03:03:34.274885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"17'382","reported_seq":395,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:34.150994+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:03:34.150994+0000","last_peered":"2024-09-22T03:03:34.150994+0000","last_clean":"2024-09-22T03:03:34.150994+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:03:34.150994+0000","last_undegraded":"2024-09-22T03:03:34.150994+0000","last_fullsized":"2024-09-22T03:03:34.150994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25100288,"num_objects":383,"num_object_clones":0,"num_object_copies":1149,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":383,"num_write_kb":24512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"17'444","reported_seq":457,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:36.255310+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:03:36.255310+0000","last_peered":"2024-09-22T03:03:36.255310+0000","last_clean":"2024-09-22T03:03:36.255310+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:03:36.255310+0000","last_undegraded":"2024-09-22T03:03:36.255310+0000","last_fullsized":"2024-09-22T03:03:36.255310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29163520,"num_objects":445,"num_object_clones":0,"num_object_copies":1335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":445,"num_write_kb":28480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.389604+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:20.389604+0000","last_peered":"2024-09-22T03:03:20.389604+0000","last_clean":"2024-09-22T03:03:20.389604+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:20.389604+0000","last_undegraded":"2024-09-22T03:03:20.389604+0000","last_fullsized":"2024-09-22T03:03:20.389604+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'455","reported_seq":468,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:36.284999+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:03:36.284999+0000","last_peered":"2024-09-22T03:03:36.284999+0000","last_clean":"2024-09-22T03:03:36.284999+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:03:36.284999+0000","last_undegraded":"2024-09-22T03:03:36.284999+0000","last_fullsized":"2024-09-22T03:03:36.284999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29884416,"num_objects":456,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":29184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.394316+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:03:20.394316+0000","last_peered":"2024-09-22T03:03:20.394316+0000","last_clean":"2024-09-22T03:03:20.394316+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:03:20.394316+0000","last_undegraded":"2024-09-22T03:03:20.394316+0000","last_fullsized":"2024-09-22T03:03:20.394316+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"17'410","reported_seq":423,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:36.249465+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:03:36.249465+0000","last_peered":"2024-09-22T03:03:36.249465+0000","last_clean":"2024-09-22T03:03:36.249465+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:03:36.249465+0000","last_undegraded":"2024-09-22T03:03:36.249465+0000","last_fullsized":"2024-09-22T03:03:36.249465+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26935296,"num_objects":411,"num_object_clones":0,"num_object_copies":1233,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":411,"num_write_kb":26304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.388644+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:20.388644+0000","last_peered":"2024-09-22T03:03:20.388644+0000","last_clean":"2024-09-22T03:03:20.388644+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:20.388644+0000","last_undegraded":"2024-09-22T03:03:20.388644+0000","last_fullsized":"2024-09-22T03:03:20.388644+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'463","reported_seq":476,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:36.314225+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:03:36.314225+0000","last_peered":"2024-09-22T03:03:36.314225+0000","last_clean":"2024-09-22T03:03:36.314225+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:03:36.314225+0000","last_undegraded":"2024-09-22T03:03:36.314225+0000","last_fullsized":"2024-09-22T03:03:36.314225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30408704,"num_objects":464,"num_object_clones":0,"num_object_copies":1392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":464,"num_write_kb":29696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.393994+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:20.393994+0000","last_peered":"2024-09-22T03:03:20.393994+0000","last_clean":"2024-09-22T03:03:20.393994+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:20.393994+0000","last_undegraded":"2024-09-22T03:03:20.393994+0000","last_fullsized":"2024-09-22T03:03:20.393994+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":151,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.396218+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:03:20.396218+0000","last_peered":"2024-09-22T03:03:20.396218+0000","last_clean":"2024-09-22T03:03:20.396218+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:03:20.396218+0000","last_undegraded":"2024-09-22T03:03:20.396218+0000","last_fullsized":"2024-09-22T03:03:20.396218+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"17'461","reported_seq":474,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:36.295691+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:03:36.295691+0000","last_peered":"2024-09-22T03:03:36.295691+0000","last_clean":"2024-09-22T03:03:36.295691+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:03:36.295691+0000","last_undegraded":"2024-09-22T03:03:36.295691+0000","last_fullsized":"2024-09-22T03:03:36.295691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30277632,"num_objects":462,"num_object_clones":0,"num_object_copies":1386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":462,"num_write_kb":29568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'415","reported_seq":428,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:36.279732+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:03:36.279732+0000","last_peered":"2024-09-22T03:03:36.279732+0000","last_clean":"2024-09-22T03:03:36.279732+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:03:36.279732+0000","last_undegraded":"2024-09-22T03:03:36.279732+0000","last_fullsized":"2024-09-22T03:03:36.279732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":416,"num_object_clones":0,"num_object_copies":1248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392562+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:20.392562+0000","last_peered":"2024-09-22T03:03:20.392562+0000","last_clean":"2024-09-22T03:03:20.392562+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:20.392562+0000","last_undegraded":"2024-09-22T03:03:20.392562+0000","last_fullsized":"2024-09-22T03:03:20.392562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'471","reported_seq":484,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:36.225855+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:03:36.225855+0000","last_peered":"2024-09-22T03:03:36.225855+0000","last_clean":"2024-09-22T03:03:36.225855+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:03:36.225855+0000","last_undegraded":"2024-09-22T03:03:36.225855+0000","last_fullsized":"2024-09-22T03:03:36.225855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30932992,"num_objects":472,"num_object_clones":0,"num_object_copies":1416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":472,"num_write_kb":30208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392946+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:20.392946+0000","last_peered":"2024-09-22T03:03:20.392946+0000","last_clean":"2024-09-22T03:03:20.392946+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:20.392946+0000","last_undegraded":"2024-09-22T03:03:20.392946+0000","last_fullsized":"2024-09-22T03:03:20.392946+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"17'455","reported_seq":468,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:36.284122+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:03:36.284122+0000","last_peered":"2024-09-22T03:03:36.284122+0000","last_clean":"2024-09-22T03:03:36.284122+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:03:36.284122+0000","last_undegraded":"2024-09-22T03:03:36.284122+0000","last_fullsized":"2024-09-22T03:03:36.284122+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29884416,"num_objects":456,"num_object_clones":0,"num_object_copies":1368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":456,"num_write_kb":29184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.397841+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:20.397841+0000","last_peered":"2024-09-22T03:03:20.397841+0000","last_clean":"2024-09-22T03:03:20.397841+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:20.397841+0000","last_undegraded":"2024-09-22T03:03:20.397841+0000","last_fullsized":"2024-09-22T03:03:20.397841+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"17'443","reported_seq":456,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:36.328041+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:03:36.328041+0000","last_peered":"2024-09-22T03:03:36.328041+0000","last_clean":"2024-09-22T03:03:36.328041+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:03:36.328041+0000","last_undegraded":"2024-09-22T03:03:36.328041+0000","last_fullsized":"2024-09-22T03:03:36.328041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29097984,"num_objects":444,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":444,"num_write_kb":28416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.398509+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:20.398509+0000","last_peered":"2024-09-22T03:03:20.398509+0000","last_clean":"2024-09-22T03:03:20.398509+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:20.398509+0000","last_undegraded":"2024-09-22T03:03:20.398509+0000","last_fullsized":"2024-09-22T03:03:20.398509+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":457637888,"num_objects":6983,"num_object_clones":0,"num_object_copies":20949,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6983,"num_write_kb":446912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":85905408,"data_stored":1374486528,"data_compressed":65264646,"data_compressed_allocated":85905408,"data_compressed_original":1374486528,"omap_allocated":0,"internal_metadata":0},"log_size":6967,"ondisk_log_size":6967,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":54752,"kb_used_data":23760,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94317088,"statfs":{"total":96636764160,"available":96580698112,"internally_reserved":0,"allocated":24330240,"data_stored":386966147,"data_compressed":18372286,"data_compressed_allocated":24182784,"data_compressed_original":386924544,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":45552,"kb_used_data":18720,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94326288,"statfs":{"total":96636764160,"available":96590118912,"internally_reserved":0,"allocated":19169280,"data_stored":303998115,"data_compressed":14434656,"data_compressed_allocated":19001344,"data_compressed_original":303939584,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":47456,"kb_used_data":20624,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94324384,"statfs":{"total":96636764160,"available":96588169216,"internally_reserved":0,"allocated":21118976,"data_stored":335193251,"data_compressed":15915878,"data_compressed_allocated":20951040,"data_compressed_original":335134720,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705693,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55728,"kb_used_data":16412,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94316112,"statfs":{"total":96636764160,"available":96579698688,"internally_reserved":0,"allocated":16805888,"data_stored":266249360,"data_compressed":12642128,"data_compressed_allocated":16642048,"data_compressed_original":266190848,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17788928,"data_stored":284622848,"data_compressed":13514646,"data_compressed_allocated":17788928,"data_compressed_original":284622848,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22208512,"data_stored":355336192,"data_compressed":16872420,"data_compressed_allocated":22208512,"data_compressed_original":355336192,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20164608,"data_stored":322633728,"data_compressed":15319622,"data_compressed_allocated":20164608,"data_compressed_original":322633728,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25743360,"data_stored":411893760,"data_compressed":19557958,"data_compressed_allocated":25743360,"data_compressed_original":411893760,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:03:40.473 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:2024-09-22T03:03:40.473017+0000 min lat: 0.009172 max lat: 0.128656 avg lat: 0.0357292 2024-09-22T03:03:40.473 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:03:40.474 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 20 16 8963 8947 27.9571 25.75 0.0287227 0.0357292 2024-09-22T03:03:40.613 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:03:40.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:40.758+0000 7f712cf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:40.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:40.766+0000 7f712cf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:41.473 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 21 16 9376 9360 27.8549 25.8125 0.041427 0.0358631 2024-09-22T03:03:42.473 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 22 16 9806 9790 27.8102 26.875 0.0169516 0.0359199 2024-09-22T03:03:43.043 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:03:43.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:43.189+0000 7fda06557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:43.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:43.197+0000 7fda06557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:43.474 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 23 16 10218 10202 27.7205 25.75 0.033888 0.0360369 2024-09-22T03:03:44.474 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 24 16 10641 10625 27.667 26.4375 0.028654 0.0361027 2024-09-22T03:03:44.944 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:03:44.944 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:03:44.945 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:03:45.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:45.091+0000 7f64218d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:45.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:45.105+0000 7f64218d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:45.400 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:45.401 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:03:45.414 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:03:45.421 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-09-22T03:03:45.312454+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":631505459,"num_objects":9631,"num_object_clones":0,"num_object_copies":28893,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":9766,"num_write_kb":618024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9711,"ondisk_log_size":9711,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":247580,"kb_used_data":111124,"kb_used_omap":0,"kb_used_meta":136384,"kb_avail":377239780,"statfs":{"total":386547056640,"available":386293534720,"internally_reserved":0,"allocated":113790976,"data_stored":1810272345,"data_compressed":85955972,"data_compressed_allocated":113143808,"data_compressed_original":1810055168,"omap_allocated":0,"internal_metadata":139657216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":318636032,"num_objects":4862,"num_object_clones":0,"num_object_copies":14586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4862,"num_write_kb":311168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002444"},"pg_stats":[{"pgid":"3.f","version":"17'645","reported_seq":658,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:44.233158+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:03:44.233158+0000","last_peered":"2024-09-22T03:03:44.233158+0000","last_clean":"2024-09-22T03:03:44.233158+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:03:44.233158+0000","last_undegraded":"2024-09-22T03:03:44.233158+0000","last_fullsized":"2024-09-22T03:03:44.233158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'616","reported_seq":629,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:41.281449+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:03:41.281449+0000","last_peered":"2024-09-22T03:03:41.281449+0000","last_clean":"2024-09-22T03:03:41.281449+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:03:41.281449+0000","last_undegraded":"2024-09-22T03:03:41.281449+0000","last_fullsized":"2024-09-22T03:03:41.281449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40435712,"num_objects":617,"num_object_clones":0,"num_object_copies":1851,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":617,"num_write_kb":39488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'560","reported_seq":573,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:41.301030+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:03:41.301030+0000","last_peered":"2024-09-22T03:03:41.301030+0000","last_clean":"2024-09-22T03:03:41.301030+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:03:41.301030+0000","last_undegraded":"2024-09-22T03:03:41.301030+0000","last_fullsized":"2024-09-22T03:03:41.301030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36765696,"num_objects":561,"num_object_clones":0,"num_object_copies":1683,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":561,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"17'674","reported_seq":687,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:44.300062+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:03:44.300062+0000","last_peered":"2024-09-22T03:03:44.300062+0000","last_clean":"2024-09-22T03:03:44.300062+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:03:44.300062+0000","last_undegraded":"2024-09-22T03:03:44.300062+0000","last_fullsized":"2024-09-22T03:03:44.300062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44236800,"num_objects":675,"num_object_clones":0,"num_object_copies":2025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":43200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'574","reported_seq":587,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:41.326759+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:03:41.326759+0000","last_peered":"2024-09-22T03:03:41.326759+0000","last_clean":"2024-09-22T03:03:41.326759+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:03:41.326759+0000","last_undegraded":"2024-09-22T03:03:41.326759+0000","last_fullsized":"2024-09-22T03:03:41.326759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37683200,"num_objects":575,"num_object_clones":0,"num_object_copies":1725,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":575,"num_write_kb":36800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"17'680","reported_seq":693,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:44.267116+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:03:44.267116+0000","last_peered":"2024-09-22T03:03:44.267116+0000","last_clean":"2024-09-22T03:03:44.267116+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:03:44.267116+0000","last_undegraded":"2024-09-22T03:03:44.267116+0000","last_fullsized":"2024-09-22T03:03:44.267116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44630016,"num_objects":681,"num_object_clones":0,"num_object_copies":2043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"17'660","reported_seq":673,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:44.302018+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:03:44.302018+0000","last_peered":"2024-09-22T03:03:44.302018+0000","last_clean":"2024-09-22T03:03:44.302018+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:03:44.302018+0000","last_undegraded":"2024-09-22T03:03:44.302018+0000","last_fullsized":"2024-09-22T03:03:44.302018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":42304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"17'560","reported_seq":573,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:41.259640+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:03:41.259640+0000","last_peered":"2024-09-22T03:03:41.259640+0000","last_clean":"2024-09-22T03:03:41.259640+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:03:41.259640+0000","last_undegraded":"2024-09-22T03:03:41.259640+0000","last_fullsized":"2024-09-22T03:03:41.259640+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36765696,"num_objects":561,"num_object_clones":0,"num_object_copies":1683,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":561,"num_write_kb":35904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.389604+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:20.389604+0000","last_peered":"2024-09-22T03:03:20.389604+0000","last_clean":"2024-09-22T03:03:20.389604+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:20.389604+0000","last_undegraded":"2024-09-22T03:03:20.389604+0000","last_fullsized":"2024-09-22T03:03:20.389604+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'581","reported_seq":594,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:41.289773+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:03:41.289773+0000","last_peered":"2024-09-22T03:03:41.289773+0000","last_clean":"2024-09-22T03:03:41.289773+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:03:41.289773+0000","last_undegraded":"2024-09-22T03:03:41.289773+0000","last_fullsized":"2024-09-22T03:03:41.289773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38141952,"num_objects":582,"num_object_clones":0,"num_object_copies":1746,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":582,"num_write_kb":37248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.394316+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:03:20.394316+0000","last_peered":"2024-09-22T03:03:20.394316+0000","last_clean":"2024-09-22T03:03:20.394316+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:03:20.394316+0000","last_undegraded":"2024-09-22T03:03:20.394316+0000","last_fullsized":"2024-09-22T03:03:20.394316+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"17'535","reported_seq":548,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:41.249218+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:03:41.249218+0000","last_peered":"2024-09-22T03:03:41.249218+0000","last_clean":"2024-09-22T03:03:41.249218+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:03:41.249218+0000","last_undegraded":"2024-09-22T03:03:41.249218+0000","last_fullsized":"2024-09-22T03:03:41.249218+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35127296,"num_objects":536,"num_object_clones":0,"num_object_copies":1608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":536,"num_write_kb":34304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.388644+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:20.388644+0000","last_peered":"2024-09-22T03:03:20.388644+0000","last_clean":"2024-09-22T03:03:20.388644+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:20.388644+0000","last_undegraded":"2024-09-22T03:03:20.388644+0000","last_fullsized":"2024-09-22T03:03:20.388644+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'606","reported_seq":619,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:41.290263+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:03:41.290263+0000","last_peered":"2024-09-22T03:03:41.290263+0000","last_clean":"2024-09-22T03:03:41.290263+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:03:41.290263+0000","last_undegraded":"2024-09-22T03:03:41.290263+0000","last_fullsized":"2024-09-22T03:03:41.290263+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":606,"log_dups_size":0,"ondisk_log_size":606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39780352,"num_objects":607,"num_object_clones":0,"num_object_copies":1821,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":607,"num_write_kb":38848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.393994+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:20.393994+0000","last_peered":"2024-09-22T03:03:20.393994+0000","last_clean":"2024-09-22T03:03:20.393994+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:20.393994+0000","last_undegraded":"2024-09-22T03:03:20.393994+0000","last_fullsized":"2024-09-22T03:03:20.393994+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":151,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.396218+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:03:20.396218+0000","last_peered":"2024-09-22T03:03:20.396218+0000","last_clean":"2024-09-22T03:03:20.396218+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:03:20.396218+0000","last_undegraded":"2024-09-22T03:03:20.396218+0000","last_fullsized":"2024-09-22T03:03:20.396218+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"17'601","reported_seq":614,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:41.338854+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:03:41.338854+0000","last_peered":"2024-09-22T03:03:41.338854+0000","last_clean":"2024-09-22T03:03:41.338854+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:03:41.338854+0000","last_undegraded":"2024-09-22T03:03:41.338854+0000","last_fullsized":"2024-09-22T03:03:41.338854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39452672,"num_objects":602,"num_object_clones":0,"num_object_copies":1806,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":602,"num_write_kb":38528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'558","reported_seq":571,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:41.337313+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:03:41.337313+0000","last_peered":"2024-09-22T03:03:41.337313+0000","last_clean":"2024-09-22T03:03:41.337313+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:03:41.337313+0000","last_undegraded":"2024-09-22T03:03:41.337313+0000","last_fullsized":"2024-09-22T03:03:41.337313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":558,"log_dups_size":0,"ondisk_log_size":558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36634624,"num_objects":559,"num_object_clones":0,"num_object_copies":1677,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":559,"num_write_kb":35776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392562+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:20.392562+0000","last_peered":"2024-09-22T03:03:20.392562+0000","last_clean":"2024-09-22T03:03:20.392562+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:20.392562+0000","last_undegraded":"2024-09-22T03:03:20.392562+0000","last_fullsized":"2024-09-22T03:03:20.392562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'609","reported_seq":622,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:41.344224+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:03:41.344224+0000","last_peered":"2024-09-22T03:03:41.344224+0000","last_clean":"2024-09-22T03:03:41.344224+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:03:41.344224+0000","last_undegraded":"2024-09-22T03:03:41.344224+0000","last_fullsized":"2024-09-22T03:03:41.344224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39976960,"num_objects":610,"num_object_clones":0,"num_object_copies":1830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":610,"num_write_kb":39040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392946+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:20.392946+0000","last_peered":"2024-09-22T03:03:20.392946+0000","last_clean":"2024-09-22T03:03:20.392946+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:20.392946+0000","last_undegraded":"2024-09-22T03:03:20.392946+0000","last_fullsized":"2024-09-22T03:03:20.392946+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"17'582","reported_seq":595,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:41.248901+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:03:41.248901+0000","last_peered":"2024-09-22T03:03:41.248901+0000","last_clean":"2024-09-22T03:03:41.248901+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:03:41.248901+0000","last_undegraded":"2024-09-22T03:03:41.248901+0000","last_fullsized":"2024-09-22T03:03:41.248901+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":582,"log_dups_size":0,"ondisk_log_size":582,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38207488,"num_objects":583,"num_object_clones":0,"num_object_copies":1749,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":583,"num_write_kb":37312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.397841+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:20.397841+0000","last_peered":"2024-09-22T03:03:20.397841+0000","last_clean":"2024-09-22T03:03:20.397841+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:20.397841+0000","last_undegraded":"2024-09-22T03:03:20.397841+0000","last_fullsized":"2024-09-22T03:03:20.397841+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"17'570","reported_seq":583,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:41.316592+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:03:41.316592+0000","last_peered":"2024-09-22T03:03:41.316592+0000","last_clean":"2024-09-22T03:03:41.316592+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:03:41.316592+0000","last_undegraded":"2024-09-22T03:03:41.316592+0000","last_fullsized":"2024-09-22T03:03:41.316592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":570,"log_dups_size":0,"ondisk_log_size":570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37421056,"num_objects":571,"num_object_clones":0,"num_object_copies":1713,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":571,"num_write_kb":36544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.398509+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:20.398509+0000","last_peered":"2024-09-22T03:03:20.398509+0000","last_clean":"2024-09-22T03:03:20.398509+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:20.398509+0000","last_undegraded":"2024-09-22T03:03:20.398509+0000","last_fullsized":"2024-09-22T03:03:20.398509+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":630915072,"num_objects":9627,"num_object_clones":0,"num_object_copies":28881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9627,"num_write_kb":616128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118071296,"data_stored":1889140736,"data_compressed":89703182,"data_compressed_allocated":118071296,"data_compressed_original":1889140736,"omap_allocated":0,"internal_metadata":0},"log_size":9611,"ondisk_log_size":9611,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66368,"kb_used_data":31216,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94305472,"statfs":{"total":96636764160,"available":96568803328,"internally_reserved":0,"allocated":31965184,"data_stored":509125251,"data_compressed":24173054,"data_compressed_allocated":31817728,"data_compressed_original":509083648,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":55668,"kb_used_data":24672,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94316172,"statfs":{"total":96636764160,"available":96579760128,"internally_reserved":0,"allocated":25264128,"data_stored":401515683,"data_compressed":19065312,"data_compressed_allocated":25096192,"data_compressed_original":401457152,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62252,"kb_used_data":27096,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94309588,"statfs":{"total":96636764160,"available":96573018112,"internally_reserved":0,"allocated":27746304,"data_stored":441230499,"data_compressed":20951094,"data_compressed_allocated":27578368,"data_compressed_original":441171968,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63292,"kb_used_data":28140,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94308548,"statfs":{"total":96636764160,"available":96571953152,"internally_reserved":0,"allocated":28815360,"data_stored":458400912,"data_compressed":21766512,"data_compressed_allocated":28651520,"data_compressed_original":458342400,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29798400,"data_stored":476774400,"data_compressed":22639030,"data_compressed_allocated":29798400,"data_compressed_original":476774400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28786688,"data_stored":460587008,"data_compressed":21870292,"data_compressed_allocated":28786688,"data_compressed_original":460587008,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":26185728,"data_stored":418971648,"data_compressed":19894262,"data_compressed_allocated":26185728,"data_compressed_original":418971648,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33300480,"data_stored":532807680,"data_compressed":25299598,"data_compressed_allocated":33300480,"data_compressed_original":532807680,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:03:45.474 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 25 16 11044 11028 27.5677 25.1875 0.0362012 0.0362243 2024-09-22T03:03:45.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:45.556+0000 7f118e197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:45.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:45.566+0000 7f118cf35640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:46.474 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 26 16 11455 11439 27.4953 25.6875 0.0228709 0.0363293 2024-09-22T03:03:47.474 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 27 16 11883 11867 27.4676 26.75 0.0332389 0.0363705 2024-09-22T03:03:47.806 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:03:47.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:47.944+0000 7f4e39a63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:47.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:47.953+0000 7f4e39a63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:48.474 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 28 16 12286 12270 27.3861 25.1875 0.0358201 0.0364809 2024-09-22T03:03:49.474 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 29 16 12702 12686 27.3382 26 0.0391507 0.0365537 2024-09-22T03:03:50.182 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:03:50.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:50.331+0000 7f1d77b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:50.338+0000 7f1d77b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:50.423 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:03:50.423 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:03:50.423 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:03:50.474 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 30 16 13097 13081 27.2499 24.6875 0.0363568 0.0366699 2024-09-22T03:03:50.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:50.577+0000 7fda4a917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:50.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:50.588+0000 7fda4a917640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:50.892 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:50.893 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:03:50.913 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-09-22T03:03:49.313291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":733610547,"num_objects":11189,"num_object_clones":0,"num_object_copies":33567,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":11324,"num_write_kb":717736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11269,"ondisk_log_size":11269,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":271032,"kb_used_data":130424,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377216328,"statfs":{"total":386547056640,"available":386269519872,"internally_reserved":0,"allocated":133554176,"data_stored":2126483545,"data_compressed":100971372,"data_compressed_allocated":132907008,"data_compressed_original":2126266368,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":275382272,"num_objects":4202,"num_object_clones":0,"num_object_copies":12606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4202,"num_write_kb":268928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002470"},"pg_stats":[{"pgid":"3.f","version":"17'645","reported_seq":658,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:44.233158+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:03:44.233158+0000","last_peered":"2024-09-22T03:03:44.233158+0000","last_clean":"2024-09-22T03:03:44.233158+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:03:44.233158+0000","last_undegraded":"2024-09-22T03:03:44.233158+0000","last_fullsized":"2024-09-22T03:03:44.233158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42336256,"num_objects":646,"num_object_clones":0,"num_object_copies":1938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":646,"num_write_kb":41344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'747","reported_seq":760,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:46.282426+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:03:46.282426+0000","last_peered":"2024-09-22T03:03:46.282426+0000","last_clean":"2024-09-22T03:03:46.282426+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:03:46.282426+0000","last_undegraded":"2024-09-22T03:03:46.282426+0000","last_fullsized":"2024-09-22T03:03:46.282426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49020928,"num_objects":748,"num_object_clones":0,"num_object_copies":2244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":748,"num_write_kb":47872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'690","reported_seq":703,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:46.262568+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:03:46.262568+0000","last_peered":"2024-09-22T03:03:46.262568+0000","last_clean":"2024-09-22T03:03:46.262568+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:03:46.262568+0000","last_undegraded":"2024-09-22T03:03:46.262568+0000","last_fullsized":"2024-09-22T03:03:46.262568+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":690,"log_dups_size":0,"ondisk_log_size":690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45285376,"num_objects":691,"num_object_clones":0,"num_object_copies":2073,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":691,"num_write_kb":44224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"17'674","reported_seq":687,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:44.300062+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:03:44.300062+0000","last_peered":"2024-09-22T03:03:44.300062+0000","last_clean":"2024-09-22T03:03:44.300062+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:03:44.300062+0000","last_undegraded":"2024-09-22T03:03:44.300062+0000","last_fullsized":"2024-09-22T03:03:44.300062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":674,"log_dups_size":0,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44236800,"num_objects":675,"num_object_clones":0,"num_object_copies":2025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":675,"num_write_kb":43200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'710","reported_seq":723,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:46.319044+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:03:46.319044+0000","last_peered":"2024-09-22T03:03:46.319044+0000","last_clean":"2024-09-22T03:03:46.319044+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:03:46.319044+0000","last_undegraded":"2024-09-22T03:03:46.319044+0000","last_fullsized":"2024-09-22T03:03:46.319044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":710,"log_dups_size":0,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46596096,"num_objects":711,"num_object_clones":0,"num_object_copies":2133,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":711,"num_write_kb":45504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"17'680","reported_seq":693,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:44.267116+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:03:44.267116+0000","last_peered":"2024-09-22T03:03:44.267116+0000","last_clean":"2024-09-22T03:03:44.267116+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:03:44.267116+0000","last_undegraded":"2024-09-22T03:03:44.267116+0000","last_fullsized":"2024-09-22T03:03:44.267116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44630016,"num_objects":681,"num_object_clones":0,"num_object_copies":2043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":681,"num_write_kb":43584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"17'660","reported_seq":673,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:44.302018+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:03:44.302018+0000","last_peered":"2024-09-22T03:03:44.302018+0000","last_clean":"2024-09-22T03:03:44.302018+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:03:44.302018+0000","last_undegraded":"2024-09-22T03:03:44.302018+0000","last_fullsized":"2024-09-22T03:03:44.302018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":661,"num_write_kb":42304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"17'691","reported_seq":704,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:46.214565+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:03:46.214565+0000","last_peered":"2024-09-22T03:03:46.214565+0000","last_clean":"2024-09-22T03:03:46.214565+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:03:46.214565+0000","last_undegraded":"2024-09-22T03:03:46.214565+0000","last_fullsized":"2024-09-22T03:03:46.214565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45350912,"num_objects":692,"num_object_clones":0,"num_object_copies":2076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":692,"num_write_kb":44288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.389604+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:20.389604+0000","last_peered":"2024-09-22T03:03:20.389604+0000","last_clean":"2024-09-22T03:03:20.389604+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:20.389604+0000","last_undegraded":"2024-09-22T03:03:20.389604+0000","last_fullsized":"2024-09-22T03:03:20.389604+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'717","reported_seq":730,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:46.248664+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:03:46.248664+0000","last_peered":"2024-09-22T03:03:46.248664+0000","last_clean":"2024-09-22T03:03:46.248664+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:03:46.248664+0000","last_undegraded":"2024-09-22T03:03:46.248664+0000","last_fullsized":"2024-09-22T03:03:46.248664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47054848,"num_objects":718,"num_object_clones":0,"num_object_copies":2154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":718,"num_write_kb":45952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.394316+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:03:20.394316+0000","last_peered":"2024-09-22T03:03:20.394316+0000","last_clean":"2024-09-22T03:03:20.394316+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:03:20.394316+0000","last_undegraded":"2024-09-22T03:03:20.394316+0000","last_fullsized":"2024-09-22T03:03:20.394316+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"17'658","reported_seq":671,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:46.319550+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:03:46.319550+0000","last_peered":"2024-09-22T03:03:46.319550+0000","last_clean":"2024-09-22T03:03:46.319550+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:03:46.319550+0000","last_undegraded":"2024-09-22T03:03:46.319550+0000","last_fullsized":"2024-09-22T03:03:46.319550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":658,"log_dups_size":0,"ondisk_log_size":658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43188224,"num_objects":659,"num_object_clones":0,"num_object_copies":1977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":659,"num_write_kb":42176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.388644+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:20.388644+0000","last_peered":"2024-09-22T03:03:20.388644+0000","last_clean":"2024-09-22T03:03:20.388644+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:20.388644+0000","last_undegraded":"2024-09-22T03:03:20.388644+0000","last_fullsized":"2024-09-22T03:03:20.388644+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'741","reported_seq":754,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:46.313343+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:03:46.313343+0000","last_peered":"2024-09-22T03:03:46.313343+0000","last_clean":"2024-09-22T03:03:46.313343+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:03:46.313343+0000","last_undegraded":"2024-09-22T03:03:46.313343+0000","last_fullsized":"2024-09-22T03:03:46.313343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":741,"log_dups_size":0,"ondisk_log_size":741,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48627712,"num_objects":742,"num_object_clones":0,"num_object_copies":2226,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":742,"num_write_kb":47488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.393994+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:20.393994+0000","last_peered":"2024-09-22T03:03:20.393994+0000","last_clean":"2024-09-22T03:03:20.393994+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:20.393994+0000","last_undegraded":"2024-09-22T03:03:20.393994+0000","last_fullsized":"2024-09-22T03:03:20.393994+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":151,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.396218+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:03:20.396218+0000","last_peered":"2024-09-22T03:03:20.396218+0000","last_clean":"2024-09-22T03:03:20.396218+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:03:20.396218+0000","last_undegraded":"2024-09-22T03:03:20.396218+0000","last_fullsized":"2024-09-22T03:03:20.396218+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"17'743","reported_seq":756,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:46.315088+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:03:46.315088+0000","last_peered":"2024-09-22T03:03:46.315088+0000","last_clean":"2024-09-22T03:03:46.315088+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:03:46.315088+0000","last_undegraded":"2024-09-22T03:03:46.315088+0000","last_fullsized":"2024-09-22T03:03:46.315088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48758784,"num_objects":744,"num_object_clones":0,"num_object_copies":2232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":744,"num_write_kb":47616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'678","reported_seq":691,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:46.321953+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:03:46.321953+0000","last_peered":"2024-09-22T03:03:46.321953+0000","last_clean":"2024-09-22T03:03:46.321953+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:03:46.321953+0000","last_undegraded":"2024-09-22T03:03:46.321953+0000","last_fullsized":"2024-09-22T03:03:46.321953+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44498944,"num_objects":679,"num_object_clones":0,"num_object_copies":2037,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":679,"num_write_kb":43456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392562+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:20.392562+0000","last_peered":"2024-09-22T03:03:20.392562+0000","last_clean":"2024-09-22T03:03:20.392562+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:20.392562+0000","last_undegraded":"2024-09-22T03:03:20.392562+0000","last_fullsized":"2024-09-22T03:03:20.392562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'744","reported_seq":757,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:46.339260+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:03:46.339260+0000","last_peered":"2024-09-22T03:03:46.339260+0000","last_clean":"2024-09-22T03:03:46.339260+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:03:46.339260+0000","last_undegraded":"2024-09-22T03:03:46.339260+0000","last_fullsized":"2024-09-22T03:03:46.339260+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48824320,"num_objects":745,"num_object_clones":0,"num_object_copies":2235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":745,"num_write_kb":47680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392946+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:20.392946+0000","last_peered":"2024-09-22T03:03:20.392946+0000","last_clean":"2024-09-22T03:03:20.392946+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:20.392946+0000","last_undegraded":"2024-09-22T03:03:20.392946+0000","last_fullsized":"2024-09-22T03:03:20.392946+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"17'707","reported_seq":720,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:46.208050+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:03:46.208050+0000","last_peered":"2024-09-22T03:03:46.208050+0000","last_clean":"2024-09-22T03:03:46.208050+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:03:46.208050+0000","last_undegraded":"2024-09-22T03:03:46.208050+0000","last_fullsized":"2024-09-22T03:03:46.208050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46399488,"num_objects":708,"num_object_clones":0,"num_object_copies":2124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":708,"num_write_kb":45312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.397841+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:20.397841+0000","last_peered":"2024-09-22T03:03:20.397841+0000","last_clean":"2024-09-22T03:03:20.397841+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:20.397841+0000","last_undegraded":"2024-09-22T03:03:20.397841+0000","last_fullsized":"2024-09-22T03:03:20.397841+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"17'684","reported_seq":697,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:46.220750+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:03:46.220750+0000","last_peered":"2024-09-22T03:03:46.220750+0000","last_clean":"2024-09-22T03:03:46.220750+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:03:46.220750+0000","last_undegraded":"2024-09-22T03:03:46.220750+0000","last_fullsized":"2024-09-22T03:03:46.220750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44892160,"num_objects":685,"num_object_clones":0,"num_object_copies":2055,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":685,"num_write_kb":43840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.398509+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:20.398509+0000","last_peered":"2024-09-22T03:03:20.398509+0000","last_clean":"2024-09-22T03:03:20.398509+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:20.398509+0000","last_undegraded":"2024-09-22T03:03:20.398509+0000","last_fullsized":"2024-09-22T03:03:20.398509+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":733020160,"num_objects":11185,"num_object_clones":0,"num_object_copies":33555,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11185,"num_write_kb":715840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":137707520,"data_stored":2203320320,"data_compressed":104622108,"data_compressed_allocated":137707520,"data_compressed_original":2203320320,"omap_allocated":0,"internal_metadata":0},"log_size":11169,"ondisk_log_size":11169,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673000,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":65392,"kb_used_data":38560,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94306448,"statfs":{"total":96636764160,"available":96569802752,"internally_reserved":0,"allocated":39485440,"data_stored":629449347,"data_compressed":29886686,"data_compressed_allocated":39337984,"data_compressed_original":629407744,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673000,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":69676,"kb_used_data":30364,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94302164,"statfs":{"total":96636764160,"available":96565415936,"internally_reserved":0,"allocated":31092736,"data_stored":494773411,"data_compressed":23493688,"data_compressed_allocated":30924800,"data_compressed_original":494714880,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673000,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72672,"kb_used_data":33360,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94299168,"statfs":{"total":96636764160,"available":96562348032,"internally_reserved":0,"allocated":34160640,"data_stored":543859875,"data_compressed":25824486,"data_compressed_allocated":33992704,"data_compressed_original":543801344,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":63292,"kb_used_data":28140,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94308548,"statfs":{"total":96636764160,"available":96571953152,"internally_reserved":0,"allocated":28815360,"data_stored":458400912,"data_compressed":21766512,"data_compressed_allocated":28651520,"data_compressed_original":458342400,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29798400,"data_stored":476774400,"data_compressed":22639030,"data_compressed_allocated":29798400,"data_compressed_original":476774400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":35147776,"data_stored":562364416,"data_compressed":26703227,"data_compressed_allocated":35147776,"data_compressed_original":562364416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31977472,"data_stored":511639552,"data_compressed":24294630,"data_compressed_allocated":31977472,"data_compressed_original":511639552,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40783872,"data_stored":652541952,"data_compressed":30985221,"data_compressed_allocated":40783872,"data_compressed_original":652541952,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:03:51.474 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 31 16 13484 13468 27.151 24.1875 0.0552467 0.0367945 2024-09-22T03:03:52.474 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 32 16 13886 13870 27.0876 25.125 0.0449896 0.0368917 2024-09-22T03:03:52.634 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:03:52.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:52.784+0000 7f86eff0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:52.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:52.794+0000 7f86eff0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:53.474 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 33 16 14274 14258 27.0016 24.25 0.0354649 0.0370093 2024-09-22T03:03:54.474 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 34 16 14664 14648 26.9243 24.375 0.0320972 0.0371102 2024-09-22T03:03:55.007 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:03:55.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:55.155+0000 7fb1f8063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:55.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:55.166+0000 7fb1f8063640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:55.475 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 35 16 15053 15037 26.8496 24.3125 0.0472682 0.037212 2024-09-22T03:03:55.916 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:03:55.916 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:03:55.917 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:03:56.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:56.072+0000 7f475c157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:56.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:56.084+0000 7f475c157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:56.425 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:03:56.425 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:03:56.445 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-22T03:03:55.314408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":901317171,"num_objects":13748,"num_object_clones":0,"num_object_copies":41244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":13883,"num_write_kb":881512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13828,"ondisk_log_size":13828,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":276304,"kb_used_data":160656,"kb_used_omap":0,"kb_used_meta":115584,"kb_avail":377211056,"statfs":{"total":386547056640,"available":386264121344,"internally_reserved":0,"allocated":164511744,"data_stored":2621804633,"data_compressed":124491865,"data_compressed_allocated":163864576,"data_compressed_original":2621587456,"omap_allocated":0,"internal_metadata":118358016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":303562752,"num_objects":4632,"num_object_clones":0,"num_object_copies":13896,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4632,"num_write_kb":296448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002396"},"pg_stats":[{"pgid":"3.f","version":"17'902","reported_seq":915,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:54.193793+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:03:54.193793+0000","last_peered":"2024-09-22T03:03:54.193793+0000","last_clean":"2024-09-22T03:03:54.193793+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:03:54.193793+0000","last_undegraded":"2024-09-22T03:03:54.193793+0000","last_fullsized":"2024-09-22T03:03:54.193793+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":902,"log_dups_size":0,"ondisk_log_size":902,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59179008,"num_objects":903,"num_object_clones":0,"num_object_copies":2709,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":57792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'875","reported_seq":888,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:51.288675+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:03:51.288675+0000","last_peered":"2024-09-22T03:03:51.288675+0000","last_clean":"2024-09-22T03:03:51.288675+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:03:51.288675+0000","last_undegraded":"2024-09-22T03:03:51.288675+0000","last_fullsized":"2024-09-22T03:03:51.288675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":56064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'813","reported_seq":826,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:51.226332+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:03:51.226332+0000","last_peered":"2024-09-22T03:03:51.226332+0000","last_clean":"2024-09-22T03:03:51.226332+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:03:51.226332+0000","last_undegraded":"2024-09-22T03:03:51.226332+0000","last_fullsized":"2024-09-22T03:03:51.226332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53346304,"num_objects":814,"num_object_clones":0,"num_object_copies":2442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":52096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"17'933","reported_seq":946,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:54.220656+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:03:54.220656+0000","last_peered":"2024-09-22T03:03:54.220656+0000","last_clean":"2024-09-22T03:03:54.220656+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:03:54.220656+0000","last_undegraded":"2024-09-22T03:03:54.220656+0000","last_fullsized":"2024-09-22T03:03:54.220656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":933,"log_dups_size":0,"ondisk_log_size":933,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61210624,"num_objects":934,"num_object_clones":0,"num_object_copies":2802,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":934,"num_write_kb":59776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'848","reported_seq":861,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:51.326066+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:03:51.326066+0000","last_peered":"2024-09-22T03:03:51.326066+0000","last_clean":"2024-09-22T03:03:51.326066+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:03:51.326066+0000","last_undegraded":"2024-09-22T03:03:51.326066+0000","last_fullsized":"2024-09-22T03:03:51.326066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55640064,"num_objects":849,"num_object_clones":0,"num_object_copies":2547,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":849,"num_write_kb":54336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"17'911","reported_seq":924,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:54.249221+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:03:54.249221+0000","last_peered":"2024-09-22T03:03:54.249221+0000","last_clean":"2024-09-22T03:03:54.249221+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:03:54.249221+0000","last_undegraded":"2024-09-22T03:03:54.249221+0000","last_fullsized":"2024-09-22T03:03:54.249221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":911,"log_dups_size":0,"ondisk_log_size":911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59768832,"num_objects":912,"num_object_clones":0,"num_object_copies":2736,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":912,"num_write_kb":58368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"17'928","reported_seq":941,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:54.256190+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:03:54.256190+0000","last_peered":"2024-09-22T03:03:54.256190+0000","last_clean":"2024-09-22T03:03:54.256190+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:03:54.256190+0000","last_undegraded":"2024-09-22T03:03:54.256190+0000","last_fullsized":"2024-09-22T03:03:54.256190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":928,"log_dups_size":0,"ondisk_log_size":928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60882944,"num_objects":929,"num_object_clones":0,"num_object_copies":2787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":929,"num_write_kb":59456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"17'809","reported_seq":822,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:51.276536+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:03:51.276536+0000","last_peered":"2024-09-22T03:03:51.276536+0000","last_clean":"2024-09-22T03:03:51.276536+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:03:51.276536+0000","last_undegraded":"2024-09-22T03:03:51.276536+0000","last_fullsized":"2024-09-22T03:03:51.276536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53084160,"num_objects":810,"num_object_clones":0,"num_object_copies":2430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":810,"num_write_kb":51840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.389604+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:20.389604+0000","last_peered":"2024-09-22T03:03:20.389604+0000","last_clean":"2024-09-22T03:03:20.389604+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:20.389604+0000","last_undegraded":"2024-09-22T03:03:20.389604+0000","last_fullsized":"2024-09-22T03:03:20.389604+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'859","reported_seq":872,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:51.312168+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:03:51.312168+0000","last_peered":"2024-09-22T03:03:51.312168+0000","last_clean":"2024-09-22T03:03:51.312168+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:03:51.312168+0000","last_undegraded":"2024-09-22T03:03:51.312168+0000","last_fullsized":"2024-09-22T03:03:51.312168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":859,"log_dups_size":0,"ondisk_log_size":859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56360960,"num_objects":860,"num_object_clones":0,"num_object_copies":2580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":860,"num_write_kb":55040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.394316+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:03:20.394316+0000","last_peered":"2024-09-22T03:03:20.394316+0000","last_clean":"2024-09-22T03:03:20.394316+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:03:20.394316+0000","last_undegraded":"2024-09-22T03:03:20.394316+0000","last_fullsized":"2024-09-22T03:03:20.394316+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"17'788","reported_seq":801,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:51.245156+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:03:51.245156+0000","last_peered":"2024-09-22T03:03:51.245156+0000","last_clean":"2024-09-22T03:03:51.245156+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:03:51.245156+0000","last_undegraded":"2024-09-22T03:03:51.245156+0000","last_fullsized":"2024-09-22T03:03:51.245156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":788,"log_dups_size":0,"ondisk_log_size":788,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51707904,"num_objects":789,"num_object_clones":0,"num_object_copies":2367,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":789,"num_write_kb":50496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.388644+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:20.388644+0000","last_peered":"2024-09-22T03:03:20.388644+0000","last_clean":"2024-09-22T03:03:20.388644+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:20.388644+0000","last_undegraded":"2024-09-22T03:03:20.388644+0000","last_fullsized":"2024-09-22T03:03:20.388644+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'850","reported_seq":863,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:51.288545+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:03:51.288545+0000","last_peered":"2024-09-22T03:03:51.288545+0000","last_clean":"2024-09-22T03:03:51.288545+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:03:51.288545+0000","last_undegraded":"2024-09-22T03:03:51.288545+0000","last_fullsized":"2024-09-22T03:03:51.288545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55771136,"num_objects":851,"num_object_clones":0,"num_object_copies":2553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":851,"num_write_kb":54464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.393994+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:20.393994+0000","last_peered":"2024-09-22T03:03:20.393994+0000","last_clean":"2024-09-22T03:03:20.393994+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:20.393994+0000","last_undegraded":"2024-09-22T03:03:20.393994+0000","last_fullsized":"2024-09-22T03:03:20.393994+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":151,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.396218+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:03:20.396218+0000","last_peered":"2024-09-22T03:03:20.396218+0000","last_clean":"2024-09-22T03:03:20.396218+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:03:20.396218+0000","last_undegraded":"2024-09-22T03:03:20.396218+0000","last_fullsized":"2024-09-22T03:03:20.396218+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"17'881","reported_seq":894,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:51.274503+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:03:51.274503+0000","last_peered":"2024-09-22T03:03:51.274503+0000","last_clean":"2024-09-22T03:03:51.274503+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:03:51.274503+0000","last_undegraded":"2024-09-22T03:03:51.274503+0000","last_fullsized":"2024-09-22T03:03:51.274503+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":881,"log_dups_size":0,"ondisk_log_size":881,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57802752,"num_objects":882,"num_object_clones":0,"num_object_copies":2646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":882,"num_write_kb":56448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'796","reported_seq":809,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:51.264821+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:03:51.264821+0000","last_peered":"2024-09-22T03:03:51.264821+0000","last_clean":"2024-09-22T03:03:51.264821+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:03:51.264821+0000","last_undegraded":"2024-09-22T03:03:51.264821+0000","last_fullsized":"2024-09-22T03:03:51.264821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":796,"log_dups_size":0,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52232192,"num_objects":797,"num_object_clones":0,"num_object_copies":2391,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":797,"num_write_kb":51008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392562+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:20.392562+0000","last_peered":"2024-09-22T03:03:20.392562+0000","last_clean":"2024-09-22T03:03:20.392562+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:20.392562+0000","last_undegraded":"2024-09-22T03:03:20.392562+0000","last_fullsized":"2024-09-22T03:03:20.392562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'875","reported_seq":888,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:51.123360+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:03:51.123360+0000","last_peered":"2024-09-22T03:03:51.123360+0000","last_clean":"2024-09-22T03:03:51.123360+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:03:51.123360+0000","last_undegraded":"2024-09-22T03:03:51.123360+0000","last_fullsized":"2024-09-22T03:03:51.123360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57409536,"num_objects":876,"num_object_clones":0,"num_object_copies":2628,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":876,"num_write_kb":56064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392946+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:20.392946+0000","last_peered":"2024-09-22T03:03:20.392946+0000","last_clean":"2024-09-22T03:03:20.392946+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:20.392946+0000","last_undegraded":"2024-09-22T03:03:20.392946+0000","last_fullsized":"2024-09-22T03:03:20.392946+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"17'847","reported_seq":860,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:51.312443+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:03:51.312443+0000","last_peered":"2024-09-22T03:03:51.312443+0000","last_clean":"2024-09-22T03:03:51.312443+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:03:51.312443+0000","last_undegraded":"2024-09-22T03:03:51.312443+0000","last_fullsized":"2024-09-22T03:03:51.312443+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55574528,"num_objects":848,"num_object_clones":0,"num_object_copies":2544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":848,"num_write_kb":54272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.397841+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:20.397841+0000","last_peered":"2024-09-22T03:03:20.397841+0000","last_clean":"2024-09-22T03:03:20.397841+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:20.397841+0000","last_undegraded":"2024-09-22T03:03:20.397841+0000","last_fullsized":"2024-09-22T03:03:20.397841+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"17'813","reported_seq":826,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:51.281912+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:03:51.281912+0000","last_peered":"2024-09-22T03:03:51.281912+0000","last_clean":"2024-09-22T03:03:51.281912+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:03:51.281912+0000","last_undegraded":"2024-09-22T03:03:51.281912+0000","last_fullsized":"2024-09-22T03:03:51.281912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":813,"log_dups_size":0,"ondisk_log_size":813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53346304,"num_objects":814,"num_object_clones":0,"num_object_copies":2442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":814,"num_write_kb":52096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.398509+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:20.398509+0000","last_peered":"2024-09-22T03:03:20.398509+0000","last_clean":"2024-09-22T03:03:20.398509+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:20.398509+0000","last_undegraded":"2024-09-22T03:03:20.398509+0000","last_fullsized":"2024-09-22T03:03:20.398509+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":900726784,"num_objects":13744,"num_object_clones":0,"num_object_copies":41232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13744,"num_write_kb":879616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":168464384,"data_stored":2695430144,"data_compressed":127990115,"data_compressed_allocated":168464384,"data_compressed_original":2695430144,"omap_allocated":0,"internal_metadata":0},"log_size":13728,"ondisk_log_size":13728,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":76808,"kb_used_data":45816,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94295032,"statfs":{"total":96636764160,"available":96558112768,"internally_reserved":0,"allocated":46915584,"data_stored":748331651,"data_compressed":35531853,"data_compressed_allocated":46768128,"data_compressed_original":748290048,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":62640,"kb_used_data":35808,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94309200,"statfs":{"total":96636764160,"available":96572620800,"internally_reserved":0,"allocated":36667392,"data_stored":583967907,"data_compressed":27729120,"data_compressed_allocated":36499456,"data_compressed_original":583909376,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":66288,"kb_used_data":39456,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94305552,"statfs":{"total":96636764160,"available":96568885248,"internally_reserved":0,"allocated":40402944,"data_stored":643736739,"data_compressed":30567173,"data_compressed_allocated":40235008,"data_compressed_original":643678208,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705713,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":70568,"kb_used_data":39576,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94301272,"statfs":{"total":96636764160,"available":96564502528,"internally_reserved":0,"allocated":40525824,"data_stored":645768336,"data_compressed":30663719,"data_compressed_allocated":40361984,"data_compressed_original":645709824,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41402368,"data_stored":662437888,"data_compressed":31455325,"data_compressed_allocated":41402368,"data_compressed_original":662437888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41345024,"data_stored":661520384,"data_compressed":31411683,"data_compressed_allocated":41345024,"data_compressed_original":661520384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37588992,"data_stored":601423872,"data_compressed":28558070,"data_compressed_allocated":37588992,"data_compressed_original":601423872,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48128000,"data_stored":770048000,"data_compressed":36565037,"data_compressed_allocated":48128000,"data_compressed_original":770048000,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:03:56.475 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 36 16 15421 15405 26.7426 23 0.0330043 0.0373643 2024-09-22T03:03:57.398 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:03:57.475 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 37 16 15810 15794 26.6769 24.3125 0.0555507 0.0374582 2024-09-22T03:03:57.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:57.547+0000 7fbd2764f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:57.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:57.554+0000 7fbd2764f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:58.475 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 38 16 16176 16160 26.5768 22.875 0.0369689 0.0376024 2024-09-22T03:03:59.475 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 39 16 16539 16523 26.477 22.6875 0.030848 0.0377353 2024-09-22T03:03:59.765 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:03:59.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:59.918+0000 7f0ca4d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:03:59.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:03:59.926+0000 7f0ca4d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:00.475 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:2024-09-22T03:04:00.474672+0000 min lat: 0.009172 max lat: 0.128656 avg lat: 0.0378767 2024-09-22T03:04:00.475 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:04:00.475 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 40 16 16901 16885 26.3806 22.625 0.0729839 0.0378767 2024-09-22T03:04:01.447 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:01.447 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:01.448 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:01.475 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 41 16 17245 17229 26.2616 21.5 0.0167518 0.0380353 2024-09-22T03:04:01.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:01.597+0000 7f43d4b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:01.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:01.609+0000 7f43d4b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:01.944 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:04:01.944 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:04:01.965 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-09-22T03:04:01.315532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1027998259,"num_objects":15681,"num_object_clones":0,"num_object_copies":47043,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":15816,"num_write_kb":1005224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15761,"ondisk_log_size":15761,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":324560,"kb_used_data":183948,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377162800,"statfs":{"total":386547056640,"available":386214707200,"internally_reserved":0,"allocated":188362752,"data_stored":3003420761,"data_compressed":142613041,"data_compressed_allocated":187715584,"data_compressed_original":3003203584,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":294387712,"num_objects":4492,"num_object_clones":0,"num_object_copies":13476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4492,"num_write_kb":287488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002240"},"pg_stats":[{"pgid":"3.f","version":"17'1035","reported_seq":1048,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:59.108537+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:03:59.108537+0000","last_peered":"2024-09-22T03:03:59.108537+0000","last_clean":"2024-09-22T03:03:59.108537+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:03:59.108537+0000","last_undegraded":"2024-09-22T03:03:59.108537+0000","last_fullsized":"2024-09-22T03:03:59.108537+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1035,"log_dups_size":0,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67895296,"num_objects":1036,"num_object_clones":0,"num_object_copies":3108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1036,"num_write_kb":66304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'990","reported_seq":1003,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:56.150829+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:03:56.150829+0000","last_peered":"2024-09-22T03:03:56.150829+0000","last_clean":"2024-09-22T03:03:56.150829+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:03:56.150829+0000","last_undegraded":"2024-09-22T03:03:56.150829+0000","last_fullsized":"2024-09-22T03:03:56.150829+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64946176,"num_objects":991,"num_object_clones":0,"num_object_copies":2973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":63424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'935","reported_seq":948,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:56.181480+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:03:56.181480+0000","last_peered":"2024-09-22T03:03:56.181480+0000","last_clean":"2024-09-22T03:03:56.181480+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:03:56.181480+0000","last_undegraded":"2024-09-22T03:03:56.181480+0000","last_fullsized":"2024-09-22T03:03:56.181480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":935,"log_dups_size":0,"ondisk_log_size":935,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61341696,"num_objects":936,"num_object_clones":0,"num_object_copies":2808,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":936,"num_write_kb":59904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"17'1053","reported_seq":1066,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:59.285236+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:03:59.285236+0000","last_peered":"2024-09-22T03:03:59.285236+0000","last_clean":"2024-09-22T03:03:59.285236+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:03:59.285236+0000","last_undegraded":"2024-09-22T03:03:59.285236+0000","last_fullsized":"2024-09-22T03:03:59.285236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1053,"log_dups_size":0,"ondisk_log_size":1053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69074944,"num_objects":1054,"num_object_clones":0,"num_object_copies":3162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1054,"num_write_kb":67456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'965","reported_seq":978,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:56.341623+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:03:56.341623+0000","last_peered":"2024-09-22T03:03:56.341623+0000","last_clean":"2024-09-22T03:03:56.341623+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:03:56.341623+0000","last_undegraded":"2024-09-22T03:03:56.341623+0000","last_fullsized":"2024-09-22T03:03:56.341623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":965,"log_dups_size":0,"ondisk_log_size":965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63307776,"num_objects":966,"num_object_clones":0,"num_object_copies":2898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":966,"num_write_kb":61824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"17'1028","reported_seq":1041,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:59.103869+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:03:59.103869+0000","last_peered":"2024-09-22T03:03:59.103869+0000","last_clean":"2024-09-22T03:03:59.103869+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:03:59.103869+0000","last_undegraded":"2024-09-22T03:03:59.103869+0000","last_fullsized":"2024-09-22T03:03:59.103869+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1028,"log_dups_size":0,"ondisk_log_size":1028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67436544,"num_objects":1029,"num_object_clones":0,"num_object_copies":3087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1029,"num_write_kb":65856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"17'1066","reported_seq":1079,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:59.239460+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:03:59.239460+0000","last_peered":"2024-09-22T03:03:59.239460+0000","last_clean":"2024-09-22T03:03:59.239460+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:03:59.239460+0000","last_undegraded":"2024-09-22T03:03:59.239460+0000","last_fullsized":"2024-09-22T03:03:59.239460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1066,"log_dups_size":0,"ondisk_log_size":1066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69926912,"num_objects":1067,"num_object_clones":0,"num_object_copies":3201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1067,"num_write_kb":68288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"17'924","reported_seq":937,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:56.282384+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:03:56.282384+0000","last_peered":"2024-09-22T03:03:56.282384+0000","last_clean":"2024-09-22T03:03:56.282384+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:03:56.282384+0000","last_undegraded":"2024-09-22T03:03:56.282384+0000","last_fullsized":"2024-09-22T03:03:56.282384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60620800,"num_objects":925,"num_object_clones":0,"num_object_copies":2775,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":925,"num_write_kb":59200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.389604+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:20.389604+0000","last_peered":"2024-09-22T03:03:20.389604+0000","last_clean":"2024-09-22T03:03:20.389604+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:20.389604+0000","last_undegraded":"2024-09-22T03:03:20.389604+0000","last_fullsized":"2024-09-22T03:03:20.389604+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'987","reported_seq":1000,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:56.303148+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:03:56.303148+0000","last_peered":"2024-09-22T03:03:56.303148+0000","last_clean":"2024-09-22T03:03:56.303148+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:03:56.303148+0000","last_undegraded":"2024-09-22T03:03:56.303148+0000","last_fullsized":"2024-09-22T03:03:56.303148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":987,"log_dups_size":0,"ondisk_log_size":987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64749568,"num_objects":988,"num_object_clones":0,"num_object_copies":2964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":988,"num_write_kb":63232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.394316+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:03:20.394316+0000","last_peered":"2024-09-22T03:03:20.394316+0000","last_clean":"2024-09-22T03:03:20.394316+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:03:20.394316+0000","last_undegraded":"2024-09-22T03:03:20.394316+0000","last_fullsized":"2024-09-22T03:03:20.394316+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"17'908","reported_seq":921,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:56.133477+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:03:56.133477+0000","last_peered":"2024-09-22T03:03:56.133477+0000","last_clean":"2024-09-22T03:03:56.133477+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:03:56.133477+0000","last_undegraded":"2024-09-22T03:03:56.133477+0000","last_fullsized":"2024-09-22T03:03:56.133477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59572224,"num_objects":909,"num_object_clones":0,"num_object_copies":2727,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":909,"num_write_kb":58176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.388644+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:20.388644+0000","last_peered":"2024-09-22T03:03:20.388644+0000","last_clean":"2024-09-22T03:03:20.388644+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:20.388644+0000","last_undegraded":"2024-09-22T03:03:20.388644+0000","last_fullsized":"2024-09-22T03:03:20.388644+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'978","reported_seq":991,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:56.275330+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:03:56.275330+0000","last_peered":"2024-09-22T03:03:56.275330+0000","last_clean":"2024-09-22T03:03:56.275330+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:03:56.275330+0000","last_undegraded":"2024-09-22T03:03:56.275330+0000","last_fullsized":"2024-09-22T03:03:56.275330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":978,"log_dups_size":0,"ondisk_log_size":978,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64159744,"num_objects":979,"num_object_clones":0,"num_object_copies":2937,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":979,"num_write_kb":62656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.393994+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:20.393994+0000","last_peered":"2024-09-22T03:03:20.393994+0000","last_clean":"2024-09-22T03:03:20.393994+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:20.393994+0000","last_undegraded":"2024-09-22T03:03:20.393994+0000","last_fullsized":"2024-09-22T03:03:20.393994+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":151,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.396218+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:03:20.396218+0000","last_peered":"2024-09-22T03:03:20.396218+0000","last_clean":"2024-09-22T03:03:20.396218+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:03:20.396218+0000","last_undegraded":"2024-09-22T03:03:20.396218+0000","last_fullsized":"2024-09-22T03:03:20.396218+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"17'995","reported_seq":1008,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:56.224123+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:03:56.224123+0000","last_peered":"2024-09-22T03:03:56.224123+0000","last_clean":"2024-09-22T03:03:56.224123+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:03:56.224123+0000","last_undegraded":"2024-09-22T03:03:56.224123+0000","last_fullsized":"2024-09-22T03:03:56.224123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":995,"log_dups_size":0,"ondisk_log_size":995,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65273856,"num_objects":996,"num_object_clones":0,"num_object_copies":2988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":996,"num_write_kb":63744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'914","reported_seq":927,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:56.123871+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:03:56.123871+0000","last_peered":"2024-09-22T03:03:56.123871+0000","last_clean":"2024-09-22T03:03:56.123871+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:03:56.123871+0000","last_undegraded":"2024-09-22T03:03:56.123871+0000","last_fullsized":"2024-09-22T03:03:56.123871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":914,"log_dups_size":0,"ondisk_log_size":914,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59965440,"num_objects":915,"num_object_clones":0,"num_object_copies":2745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":915,"num_write_kb":58560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392562+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:20.392562+0000","last_peered":"2024-09-22T03:03:20.392562+0000","last_clean":"2024-09-22T03:03:20.392562+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:20.392562+0000","last_undegraded":"2024-09-22T03:03:20.392562+0000","last_fullsized":"2024-09-22T03:03:20.392562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'994","reported_seq":1007,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:56.335091+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:03:56.335091+0000","last_peered":"2024-09-22T03:03:56.335091+0000","last_clean":"2024-09-22T03:03:56.335091+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:03:56.335091+0000","last_undegraded":"2024-09-22T03:03:56.335091+0000","last_fullsized":"2024-09-22T03:03:56.335091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":994,"log_dups_size":0,"ondisk_log_size":994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65208320,"num_objects":995,"num_object_clones":0,"num_object_copies":2985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":995,"num_write_kb":63680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392946+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:20.392946+0000","last_peered":"2024-09-22T03:03:20.392946+0000","last_clean":"2024-09-22T03:03:20.392946+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:20.392946+0000","last_undegraded":"2024-09-22T03:03:20.392946+0000","last_fullsized":"2024-09-22T03:03:20.392946+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"17'962","reported_seq":975,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:56.138791+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:03:56.138791+0000","last_peered":"2024-09-22T03:03:56.138791+0000","last_clean":"2024-09-22T03:03:56.138791+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:03:56.138791+0000","last_undegraded":"2024-09-22T03:03:56.138791+0000","last_fullsized":"2024-09-22T03:03:56.138791+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":962,"log_dups_size":0,"ondisk_log_size":962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63111168,"num_objects":963,"num_object_clones":0,"num_object_copies":2889,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":963,"num_write_kb":61632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.397841+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:20.397841+0000","last_peered":"2024-09-22T03:03:20.397841+0000","last_clean":"2024-09-22T03:03:20.397841+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:20.397841+0000","last_undegraded":"2024-09-22T03:03:20.397841+0000","last_fullsized":"2024-09-22T03:03:20.397841+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"17'927","reported_seq":940,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:56.251590+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:03:56.251590+0000","last_peered":"2024-09-22T03:03:56.251590+0000","last_clean":"2024-09-22T03:03:56.251590+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:03:56.251590+0000","last_undegraded":"2024-09-22T03:03:56.251590+0000","last_fullsized":"2024-09-22T03:03:56.251590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":927,"log_dups_size":0,"ondisk_log_size":927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":928,"num_object_clones":0,"num_object_copies":2784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":928,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.398509+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:20.398509+0000","last_peered":"2024-09-22T03:03:20.398509+0000","last_clean":"2024-09-22T03:03:20.398509+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:20.398509+0000","last_undegraded":"2024-09-22T03:03:20.398509+0000","last_fullsized":"2024-09-22T03:03:20.398509+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1027407872,"num_objects":15677,"num_object_clones":0,"num_object_copies":47031,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15677,"num_write_kb":1003328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":192028672,"data_stored":3072458752,"data_compressed":145893451,"data_compressed_allocated":192028672,"data_compressed_original":3072458752,"omap_allocated":0,"internal_metadata":0},"log_size":15661,"ondisk_log_size":15661,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":91924,"kb_used_data":52612,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94279916,"statfs":{"total":96636764160,"available":96542633984,"internally_reserved":0,"allocated":53874688,"data_stored":859677315,"data_compressed":40819141,"data_compressed_allocated":53727232,"data_compressed_original":859635712,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":72232,"kb_used_data":41240,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94299608,"statfs":{"total":96636764160,"available":96562798592,"internally_reserved":0,"allocated":42229760,"data_stored":672965795,"data_compressed":31955216,"data_compressed_allocated":42061824,"data_compressed_original":672907264,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":80448,"kb_used_data":45296,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94291392,"statfs":{"total":96636764160,"available":96554385408,"internally_reserved":0,"allocated":46383104,"data_stored":739419299,"data_compressed":35110693,"data_compressed_allocated":46215168,"data_compressed_original":739360768,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705718,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":79956,"kb_used_data":44800,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94291884,"statfs":{"total":96636764160,"available":96554889216,"internally_reserved":0,"allocated":45875200,"data_stored":731358352,"data_compressed":34727991,"data_compressed_allocated":45711360,"data_compressed_original":731299840,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46657536,"data_stored":746520576,"data_compressed":35448021,"data_compressed_allocated":46657536,"data_compressed_original":746520576,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":47345664,"data_stored":757530624,"data_compressed":35970763,"data_compressed_allocated":47345664,"data_compressed_original":757530624,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":42999808,"data_stored":687996928,"data_compressed":32669022,"data_compressed_allocated":42999808,"data_compressed_original":687996928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":55025664,"data_stored":880410624,"data_compressed":41805645,"data_compressed_allocated":55025664,"data_compressed_original":880410624,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:02.195 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:02.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:02.333+0000 7efed68c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:02.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:02.340+0000 7efed68c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:02.475 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 42 16 17593 17577 26.1541 21.75 0.0419457 0.0381942 2024-09-22T03:04:03.475 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 43 16 17964 17948 26.0851 23.1875 0.0201257 0.0383156 2024-09-22T03:04:04.475 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 44 16 18328 18312 26.0092 22.75 0.0406616 0.038423 2024-09-22T03:04:04.637 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:04.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:04.770+0000 7f1102357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:04.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:04.778+0000 7f1102357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:05.475 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 45 16 18693 18677 25.9381 22.8125 0.0343958 0.0385281 2024-09-22T03:04:06.476 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 46 16 19071 19055 25.8878 23.625 0.0469991 0.0386073 2024-09-22T03:04:06.967 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:06.967 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:06.967 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:07.018 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:07.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:07.119+0000 7f019bc18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:07.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:07.134+0000 7f019bc18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:07.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:07.176+0000 7fa581c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:07.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:07.186+0000 7fa581c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:07.476 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 47 16 19412 19396 25.7904 21.3125 0.0348085 0.0387439 2024-09-22T03:04:07.505 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:04:07.506 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:04:07.530 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-09-22T03:04:07.316776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1234502195,"num_objects":18832,"num_object_clones":0,"num_object_copies":56496,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":18967,"num_write_kb":1206888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18912,"ondisk_log_size":18912,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":363264,"kb_used_data":222652,"kb_used_omap":0,"kb_used_meta":140544,"kb_avail":377124096,"statfs":{"total":386547056640,"available":386175074304,"internally_reserved":0,"allocated":227995648,"data_stored":3637547097,"data_compressed":172724753,"data_compressed_allocated":227348480,"data_compressed_original":3637329920,"omap_allocated":0,"internal_metadata":143917056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":333185024,"num_objects":5084,"num_object_clones":0,"num_object_copies":15252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5084,"num_write_kb":325376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002367"},"pg_stats":[{"pgid":"3.f","version":"17'1150","reported_seq":1163,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:04.295948+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:04:04.295948+0000","last_peered":"2024-09-22T03:04:04.295948+0000","last_clean":"2024-09-22T03:04:04.295948+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:04:04.295948+0000","last_undegraded":"2024-09-22T03:04:04.295948+0000","last_fullsized":"2024-09-22T03:04:04.295948+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75431936,"num_objects":1151,"num_object_clones":0,"num_object_copies":3453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'1225","reported_seq":1238,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:06.335760+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:04:06.335760+0000","last_peered":"2024-09-22T03:04:06.335760+0000","last_clean":"2024-09-22T03:04:06.335760+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:04:06.335760+0000","last_undegraded":"2024-09-22T03:04:06.335760+0000","last_fullsized":"2024-09-22T03:04:06.335760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1225,"log_dups_size":0,"ondisk_log_size":1225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80347136,"num_objects":1226,"num_object_clones":0,"num_object_copies":3678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":78464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1161","reported_seq":1174,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:06.253116+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:04:06.253116+0000","last_peered":"2024-09-22T03:04:06.253116+0000","last_clean":"2024-09-22T03:04:06.253116+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:04:06.253116+0000","last_undegraded":"2024-09-22T03:04:06.253116+0000","last_fullsized":"2024-09-22T03:04:06.253116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1161,"log_dups_size":0,"ondisk_log_size":1161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76152832,"num_objects":1162,"num_object_clones":0,"num_object_copies":3486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1162,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"17'1150","reported_seq":1163,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:03.995912+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:04:03.995912+0000","last_peered":"2024-09-22T03:04:03.995912+0000","last_clean":"2024-09-22T03:04:03.995912+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:04:03.995912+0000","last_undegraded":"2024-09-22T03:04:03.995912+0000","last_fullsized":"2024-09-22T03:04:03.995912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1150,"log_dups_size":0,"ondisk_log_size":1150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75431936,"num_objects":1151,"num_object_clones":0,"num_object_copies":3453,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1151,"num_write_kb":73664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'1192","reported_seq":1205,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:06.217942+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:04:06.217942+0000","last_peered":"2024-09-22T03:04:06.217942+0000","last_clean":"2024-09-22T03:04:06.217942+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:04:06.217942+0000","last_undegraded":"2024-09-22T03:04:06.217942+0000","last_fullsized":"2024-09-22T03:04:06.217942+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1192,"log_dups_size":0,"ondisk_log_size":1192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78184448,"num_objects":1193,"num_object_clones":0,"num_object_copies":3579,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1193,"num_write_kb":76352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"17'1135","reported_seq":1148,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:04.256366+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:04:04.256366+0000","last_peered":"2024-09-22T03:04:04.256366+0000","last_clean":"2024-09-22T03:04:04.256366+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:04:04.256366+0000","last_undegraded":"2024-09-22T03:04:04.256366+0000","last_fullsized":"2024-09-22T03:04:04.256366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1135,"log_dups_size":0,"ondisk_log_size":1135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74448896,"num_objects":1136,"num_object_clones":0,"num_object_copies":3408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1136,"num_write_kb":72704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"17'1181","reported_seq":1194,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:04.170352+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:04:04.170352+0000","last_peered":"2024-09-22T03:04:04.170352+0000","last_clean":"2024-09-22T03:04:04.170352+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:04:04.170352+0000","last_undegraded":"2024-09-22T03:04:04.170352+0000","last_fullsized":"2024-09-22T03:04:04.170352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1181,"log_dups_size":0,"ondisk_log_size":1181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77463552,"num_objects":1182,"num_object_clones":0,"num_object_copies":3546,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1182,"num_write_kb":75648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"17'1161","reported_seq":1174,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:06.319212+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:04:06.319212+0000","last_peered":"2024-09-22T03:04:06.319212+0000","last_clean":"2024-09-22T03:04:06.319212+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:04:06.319212+0000","last_undegraded":"2024-09-22T03:04:06.319212+0000","last_fullsized":"2024-09-22T03:04:06.319212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1161,"log_dups_size":0,"ondisk_log_size":1161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76152832,"num_objects":1162,"num_object_clones":0,"num_object_copies":3486,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1162,"num_write_kb":74368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.389604+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:20.389604+0000","last_peered":"2024-09-22T03:03:20.389604+0000","last_clean":"2024-09-22T03:03:20.389604+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:20.389604+0000","last_undegraded":"2024-09-22T03:03:20.389604+0000","last_fullsized":"2024-09-22T03:03:20.389604+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'1191","reported_seq":1204,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:06.269188+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:04:06.269188+0000","last_peered":"2024-09-22T03:04:06.269188+0000","last_clean":"2024-09-22T03:04:06.269188+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:04:06.269188+0000","last_undegraded":"2024-09-22T03:04:06.269188+0000","last_fullsized":"2024-09-22T03:04:06.269188+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78118912,"num_objects":1192,"num_object_clones":0,"num_object_copies":3576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1192,"num_write_kb":76288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.394316+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:03:20.394316+0000","last_peered":"2024-09-22T03:03:20.394316+0000","last_clean":"2024-09-22T03:03:20.394316+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:03:20.394316+0000","last_undegraded":"2024-09-22T03:03:20.394316+0000","last_fullsized":"2024-09-22T03:03:20.394316+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"17'1108","reported_seq":1121,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:06.341189+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:04:06.341189+0000","last_peered":"2024-09-22T03:04:06.341189+0000","last_clean":"2024-09-22T03:04:06.341189+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:04:06.341189+0000","last_undegraded":"2024-09-22T03:04:06.341189+0000","last_fullsized":"2024-09-22T03:04:06.341189+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1108,"log_dups_size":0,"ondisk_log_size":1108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72679424,"num_objects":1109,"num_object_clones":0,"num_object_copies":3327,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1109,"num_write_kb":70976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.388644+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:20.388644+0000","last_peered":"2024-09-22T03:03:20.388644+0000","last_clean":"2024-09-22T03:03:20.388644+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:20.388644+0000","last_undegraded":"2024-09-22T03:03:20.388644+0000","last_fullsized":"2024-09-22T03:03:20.388644+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'1212","reported_seq":1225,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:06.184303+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:04:06.184303+0000","last_peered":"2024-09-22T03:04:06.184303+0000","last_clean":"2024-09-22T03:04:06.184303+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:04:06.184303+0000","last_undegraded":"2024-09-22T03:04:06.184303+0000","last_fullsized":"2024-09-22T03:04:06.184303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1212,"log_dups_size":0,"ondisk_log_size":1212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79495168,"num_objects":1213,"num_object_clones":0,"num_object_copies":3639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1213,"num_write_kb":77632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.393994+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:20.393994+0000","last_peered":"2024-09-22T03:03:20.393994+0000","last_clean":"2024-09-22T03:03:20.393994+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:20.393994+0000","last_undegraded":"2024-09-22T03:03:20.393994+0000","last_fullsized":"2024-09-22T03:03:20.393994+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":151,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.396218+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:03:20.396218+0000","last_peered":"2024-09-22T03:03:20.396218+0000","last_clean":"2024-09-22T03:03:20.396218+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:03:20.396218+0000","last_undegraded":"2024-09-22T03:03:20.396218+0000","last_fullsized":"2024-09-22T03:03:20.396218+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"17'1246","reported_seq":1259,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:06.312295+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:04:06.312295+0000","last_peered":"2024-09-22T03:04:06.312295+0000","last_clean":"2024-09-22T03:04:06.312295+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:04:06.312295+0000","last_undegraded":"2024-09-22T03:04:06.312295+0000","last_fullsized":"2024-09-22T03:04:06.312295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1246,"log_dups_size":0,"ondisk_log_size":1246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81723392,"num_objects":1247,"num_object_clones":0,"num_object_copies":3741,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1247,"num_write_kb":79808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1131","reported_seq":1144,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:06.261958+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:04:06.261958+0000","last_peered":"2024-09-22T03:04:06.261958+0000","last_clean":"2024-09-22T03:04:06.261958+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:04:06.261958+0000","last_undegraded":"2024-09-22T03:04:06.261958+0000","last_fullsized":"2024-09-22T03:04:06.261958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1131,"log_dups_size":0,"ondisk_log_size":1131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74186752,"num_objects":1132,"num_object_clones":0,"num_object_copies":3396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1132,"num_write_kb":72448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392562+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:20.392562+0000","last_peered":"2024-09-22T03:03:20.392562+0000","last_clean":"2024-09-22T03:03:20.392562+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:20.392562+0000","last_undegraded":"2024-09-22T03:03:20.392562+0000","last_fullsized":"2024-09-22T03:03:20.392562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'1225","reported_seq":1238,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:06.234530+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:04:06.234530+0000","last_peered":"2024-09-22T03:04:06.234530+0000","last_clean":"2024-09-22T03:04:06.234530+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:04:06.234530+0000","last_undegraded":"2024-09-22T03:04:06.234530+0000","last_fullsized":"2024-09-22T03:04:06.234530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1225,"log_dups_size":0,"ondisk_log_size":1225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":80347136,"num_objects":1226,"num_object_clones":0,"num_object_copies":3678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1226,"num_write_kb":78464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392946+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:20.392946+0000","last_peered":"2024-09-22T03:03:20.392946+0000","last_clean":"2024-09-22T03:03:20.392946+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:20.392946+0000","last_undegraded":"2024-09-22T03:03:20.392946+0000","last_fullsized":"2024-09-22T03:03:20.392946+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"17'1157","reported_seq":1170,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:06.330543+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:04:06.330543+0000","last_peered":"2024-09-22T03:04:06.330543+0000","last_clean":"2024-09-22T03:04:06.330543+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:04:06.330543+0000","last_undegraded":"2024-09-22T03:04:06.330543+0000","last_fullsized":"2024-09-22T03:04:06.330543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1157,"log_dups_size":0,"ondisk_log_size":1157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75890688,"num_objects":1158,"num_object_clones":0,"num_object_copies":3474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1158,"num_write_kb":74112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.397841+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:20.397841+0000","last_peered":"2024-09-22T03:03:20.397841+0000","last_clean":"2024-09-22T03:03:20.397841+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:20.397841+0000","last_undegraded":"2024-09-22T03:03:20.397841+0000","last_fullsized":"2024-09-22T03:03:20.397841+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"17'1187","reported_seq":1200,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:06.287699+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:04:06.287699+0000","last_peered":"2024-09-22T03:04:06.287699+0000","last_clean":"2024-09-22T03:04:06.287699+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:04:06.287699+0000","last_undegraded":"2024-09-22T03:04:06.287699+0000","last_fullsized":"2024-09-22T03:04:06.287699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1187,"log_dups_size":0,"ondisk_log_size":1187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":77856768,"num_objects":1188,"num_object_clones":0,"num_object_copies":3564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1188,"num_write_kb":76032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.398509+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:20.398509+0000","last_peered":"2024-09-22T03:03:20.398509+0000","last_clean":"2024-09-22T03:03:20.398509+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:20.398509+0000","last_undegraded":"2024-09-22T03:03:20.398509+0000","last_fullsized":"2024-09-22T03:03:20.398509+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1233911808,"num_objects":18828,"num_object_clones":0,"num_object_copies":56484,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18828,"num_write_kb":1204992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":231641088,"data_stored":3706257408,"data_compressed":175989603,"data_compressed_allocated":231641088,"data_compressed_original":3706257408,"omap_allocated":0,"internal_metadata":0},"log_size":18812,"ondisk_log_size":18812,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":100448,"kb_used_data":65296,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94271392,"statfs":{"total":96636764160,"available":96533905408,"internally_reserved":0,"allocated":66863104,"data_stored":1067491971,"data_compressed":50687293,"data_compressed_allocated":66715648,"data_compressed_original":1067450368,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":90504,"kb_used_data":51192,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94281336,"statfs":{"total":96636764160,"available":96544088064,"internally_reserved":0,"allocated":52420608,"data_stored":836019363,"data_compressed":39697872,"data_compressed_allocated":52252672,"data_compressed_original":835960832,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673020,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":83392,"kb_used_data":56556,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94288448,"statfs":{"total":96636764160,"available":96551370752,"internally_reserved":0,"allocated":57913344,"data_stored":923903139,"data_compressed":43870973,"data_compressed_allocated":57745408,"data_compressed_original":923844608,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":88920,"kb_used_data":49608,"kb_used_omap":0,"kb_used_meta":39296,"kb_avail":94282920,"statfs":{"total":96636764160,"available":96545710080,"internally_reserved":0,"allocated":50798592,"data_stored":810132624,"data_compressed":38468615,"data_compressed_allocated":50634752,"data_compressed_original":810074112,"omap_allocated":0,"internal_metadata":40239104},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":51576832,"data_stored":825229312,"data_compressed":39185533,"data_compressed_allocated":51576832,"data_compressed_original":825229312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58830848,"data_stored":941293568,"data_compressed":44696811,"data_compressed_allocated":58830848,"data_compressed_original":941293568,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":53219328,"data_stored":851509248,"data_compressed":40433462,"data_compressed_allocated":53219328,"data_compressed_original":851509248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":68014080,"data_stored":1088225280,"data_compressed":51673797,"data_compressed_allocated":68014080,"data_compressed_original":1088225280,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:08.476 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 48 16 19780 19764 25.7323 23 0.0361272 0.0388381 2024-09-22T03:04:09.477 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 49 16 20144 20128 25.6713 22.75 0.0438834 0.0389227 2024-09-22T03:04:09.557 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:09.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:09.694+0000 7f9cd50fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:09.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:09.701+0000 7f9cd50fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:10.476 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 50 16 20502 20486 25.6054 22.375 0.0224097 0.0390311 2024-09-22T03:04:11.476 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 51 15 20870 20855 25.5555 23.0625 0.0361834 0.0391058 2024-09-22T03:04:11.981 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:12.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:12.137+0000 7f75984ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:12.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:12.143+0000 7f75984ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:12.476 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 52 16 21203 21187 25.463 20.75 0.0320357 0.0392434 2024-09-22T03:04:12.532 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:12.533 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:04:12.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:12.693+0000 7fe4ea8ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:12.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:12.711+0000 7fe4ea8ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:13.071 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:04:13.091 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:04:13.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:13.247+0000 7fb479b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:13.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:13.262+0000 7fb479b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:13.476 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 53 16 21545 21529 25.3859 21.375 0.0578219 0.0393669 2024-09-22T03:04:14.081 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:04:14.103 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:04:14.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:14.255+0000 7fc81670e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:14.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:14.269+0000 7fc81670e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:14.412 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:14.479 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 54 16 21898 21882 25.3228 22.0625 0.0355865 0.0394699 2024-09-22T03:04:14.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:14.558+0000 7fc0a0597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:14.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:14.569+0000 7fc0a0597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:15.086 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:04:15.104 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:04:15.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:15.256+0000 7f86f206c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:15.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:15.271+0000 7f86f206c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:15.479 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 55 16 22232 22216 25.2419 20.875 0.0465195 0.039592 2024-09-22T03:04:16.093 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:04:16.114 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:04:16.114 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:16.272+0000 7f959c517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:16.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:16.282+0000 7f959c517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:16.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 56 16 22572 22556 25.1706 21.25 0.0408064 0.0397066 2024-09-22T03:04:16.559 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:04:16.560 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:04:16.580 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-22T03:04:16.095459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1382416947,"num_objects":21089,"num_object_clones":0,"num_object_copies":63267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":21224,"num_write_kb":1351336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21169,"ondisk_log_size":21169,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":395440,"kb_used_data":249264,"kb_used_omap":0,"kb_used_meta":146112,"kb_avail":377091920,"statfs":{"total":386547056640,"available":386142126080,"internally_reserved":0,"allocated":255246336,"data_stored":4073430306,"data_compressed":193422665,"data_compressed_allocated":254590976,"data_compressed_original":4073209856,"omap_allocated":0,"internal_metadata":149618688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":118030336,"num_objects":1801,"num_object_clones":0,"num_object_copies":5403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1801,"num_write_kb":115264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.777886"},"pg_stats":[{"pgid":"3.f","version":"19'1392","reported_seq":1411,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:14.310111+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:04:14.310111+0000","last_peered":"2024-09-22T03:04:14.310111+0000","last_clean":"2024-09-22T03:04:14.310111+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:04:14.310111+0000","last_undegraded":"2024-09-22T03:04:14.310111+0000","last_fullsized":"2024-09-22T03:04:14.310111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1392,"log_dups_size":0,"ondisk_log_size":1392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91291648,"num_objects":1393,"num_object_clones":0,"num_object_copies":4179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1393,"num_write_kb":89152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'1343","reported_seq":1356,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.262854+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:04:11.262854+0000","last_peered":"2024-09-22T03:04:11.262854+0000","last_clean":"2024-09-22T03:04:11.262854+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:04:11.262854+0000","last_undegraded":"2024-09-22T03:04:11.262854+0000","last_fullsized":"2024-09-22T03:04:11.262854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":1344,"num_object_clones":0,"num_object_copies":4032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1344,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1273","reported_seq":1286,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.171903+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:04:11.171903+0000","last_peered":"2024-09-22T03:04:11.171903+0000","last_clean":"2024-09-22T03:04:11.171903+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:04:11.171903+0000","last_undegraded":"2024-09-22T03:04:11.171903+0000","last_fullsized":"2024-09-22T03:04:11.171903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83492864,"num_objects":1274,"num_object_clones":0,"num_object_copies":3822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1274,"num_write_kb":81536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"19'1364","reported_seq":1383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:14.243583+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:04:14.243583+0000","last_peered":"2024-09-22T03:04:14.243583+0000","last_clean":"2024-09-22T03:04:14.243583+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:04:14.243583+0000","last_undegraded":"2024-09-22T03:04:14.243583+0000","last_fullsized":"2024-09-22T03:04:14.243583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1364,"log_dups_size":0,"ondisk_log_size":1364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89456640,"num_objects":1365,"num_object_clones":0,"num_object_copies":4095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1365,"num_write_kb":87360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'1294","reported_seq":1307,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.245209+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:04:11.245209+0000","last_peered":"2024-09-22T03:04:11.245209+0000","last_clean":"2024-09-22T03:04:11.245209+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:04:11.245209+0000","last_undegraded":"2024-09-22T03:04:11.245209+0000","last_fullsized":"2024-09-22T03:04:11.245209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84869120,"num_objects":1295,"num_object_clones":0,"num_object_copies":3885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":82880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"19'1356","reported_seq":1375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:14.140111+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:04:14.140111+0000","last_peered":"2024-09-22T03:04:14.140111+0000","last_clean":"2024-09-22T03:04:14.140111+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:04:14.140111+0000","last_undegraded":"2024-09-22T03:04:14.140111+0000","last_fullsized":"2024-09-22T03:04:14.140111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1356,"log_dups_size":0,"ondisk_log_size":1356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88932352,"num_objects":1357,"num_object_clones":0,"num_object_copies":4071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1357,"num_write_kb":86848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"19'1407","reported_seq":1426,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:14.287111+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:04:14.287111+0000","last_peered":"2024-09-22T03:04:14.287111+0000","last_clean":"2024-09-22T03:04:14.287111+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:04:14.287111+0000","last_undegraded":"2024-09-22T03:04:14.287111+0000","last_fullsized":"2024-09-22T03:04:14.287111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1407,"log_dups_size":0,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":1408,"num_object_clones":0,"num_object_copies":4224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1408,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"17'1262","reported_seq":1275,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.292679+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:04:11.292679+0000","last_peered":"2024-09-22T03:04:11.292679+0000","last_clean":"2024-09-22T03:04:11.292679+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:04:11.292679+0000","last_undegraded":"2024-09-22T03:04:11.292679+0000","last_fullsized":"2024-09-22T03:04:11.292679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1262,"log_dups_size":0,"ondisk_log_size":1262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82771968,"num_objects":1263,"num_object_clones":0,"num_object_copies":3789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":80832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.389604+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:20.389604+0000","last_peered":"2024-09-22T03:03:20.389604+0000","last_clean":"2024-09-22T03:03:20.389604+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:20.389604+0000","last_undegraded":"2024-09-22T03:03:20.389604+0000","last_fullsized":"2024-09-22T03:03:20.389604+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'1319","reported_seq":1332,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.275195+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:04:11.275195+0000","last_peered":"2024-09-22T03:04:11.275195+0000","last_clean":"2024-09-22T03:04:11.275195+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:04:11.275195+0000","last_undegraded":"2024-09-22T03:04:11.275195+0000","last_fullsized":"2024-09-22T03:04:11.275195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1319,"log_dups_size":0,"ondisk_log_size":1319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86507520,"num_objects":1320,"num_object_clones":0,"num_object_copies":3960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1320,"num_write_kb":84480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:14.091653+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:14.091653+0000","last_peered":"2024-09-22T03:04:14.091653+0000","last_clean":"2024-09-22T03:04:14.091653+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:14.091653+0000","last_undegraded":"2024-09-22T03:04:14.091653+0000","last_fullsized":"2024-09-22T03:04:14.091653+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"17'1201","reported_seq":1214,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.339267+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:04:11.339267+0000","last_peered":"2024-09-22T03:04:11.339267+0000","last_clean":"2024-09-22T03:04:11.339267+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:04:11.339267+0000","last_undegraded":"2024-09-22T03:04:11.339267+0000","last_fullsized":"2024-09-22T03:04:11.339267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1201,"log_dups_size":0,"ondisk_log_size":1201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78774272,"num_objects":1202,"num_object_clones":0,"num_object_copies":3606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":76928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.388644+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:20.388644+0000","last_peered":"2024-09-22T03:03:20.388644+0000","last_clean":"2024-09-22T03:03:20.388644+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:20.388644+0000","last_undegraded":"2024-09-22T03:03:20.388644+0000","last_fullsized":"2024-09-22T03:03:20.388644+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'1333","reported_seq":1346,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.296227+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:04:11.296227+0000","last_peered":"2024-09-22T03:04:11.296227+0000","last_clean":"2024-09-22T03:04:11.296227+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:04:11.296227+0000","last_undegraded":"2024-09-22T03:04:11.296227+0000","last_fullsized":"2024-09-22T03:04:11.296227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1333,"log_dups_size":0,"ondisk_log_size":1333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87425024,"num_objects":1334,"num_object_clones":0,"num_object_copies":4002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1334,"num_write_kb":85376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.393994+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:20.393994+0000","last_peered":"2024-09-22T03:03:20.393994+0000","last_clean":"2024-09-22T03:03:20.393994+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:20.393994+0000","last_undegraded":"2024-09-22T03:03:20.393994+0000","last_fullsized":"2024-09-22T03:03:20.393994+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:14.097011+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:14.097011+0000","last_peered":"2024-09-22T03:04:14.097011+0000","last_clean":"2024-09-22T03:04:14.097011+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:14.097011+0000","last_undegraded":"2024-09-22T03:04:14.097011+0000","last_fullsized":"2024-09-22T03:04:14.097011+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"17'1387","reported_seq":1400,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.299593+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:04:11.299593+0000","last_peered":"2024-09-22T03:04:11.299593+0000","last_clean":"2024-09-22T03:04:11.299593+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:04:11.299593+0000","last_undegraded":"2024-09-22T03:04:11.299593+0000","last_fullsized":"2024-09-22T03:04:11.299593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1387,"log_dups_size":0,"ondisk_log_size":1387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90963968,"num_objects":1388,"num_object_clones":0,"num_object_copies":4164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1388,"num_write_kb":88832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1251","reported_seq":1264,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.229799+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:04:11.229799+0000","last_peered":"2024-09-22T03:04:11.229799+0000","last_clean":"2024-09-22T03:04:11.229799+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:04:11.229799+0000","last_undegraded":"2024-09-22T03:04:11.229799+0000","last_fullsized":"2024-09-22T03:04:11.229799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1251,"log_dups_size":0,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82051072,"num_objects":1252,"num_object_clones":0,"num_object_copies":3756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1252,"num_write_kb":80128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392562+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:20.392562+0000","last_peered":"2024-09-22T03:03:20.392562+0000","last_clean":"2024-09-22T03:03:20.392562+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:20.392562+0000","last_undegraded":"2024-09-22T03:03:20.392562+0000","last_fullsized":"2024-09-22T03:03:20.392562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'1336","reported_seq":1349,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.317415+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:04:11.317415+0000","last_peered":"2024-09-22T03:04:11.317415+0000","last_clean":"2024-09-22T03:04:11.317415+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:04:11.317415+0000","last_undegraded":"2024-09-22T03:04:11.317415+0000","last_fullsized":"2024-09-22T03:04:11.317415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1336,"log_dups_size":0,"ondisk_log_size":1336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87621632,"num_objects":1337,"num_object_clones":0,"num_object_copies":4011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1337,"num_write_kb":85568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392946+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:20.392946+0000","last_peered":"2024-09-22T03:03:20.392946+0000","last_clean":"2024-09-22T03:03:20.392946+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:20.392946+0000","last_undegraded":"2024-09-22T03:03:20.392946+0000","last_fullsized":"2024-09-22T03:03:20.392946+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"17'1264","reported_seq":1277,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.293253+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:04:11.293253+0000","last_peered":"2024-09-22T03:04:11.293253+0000","last_clean":"2024-09-22T03:04:11.293253+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:04:11.293253+0000","last_undegraded":"2024-09-22T03:04:11.293253+0000","last_fullsized":"2024-09-22T03:04:11.293253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82903040,"num_objects":1265,"num_object_clones":0,"num_object_copies":3795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1265,"num_write_kb":80960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.397841+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:20.397841+0000","last_peered":"2024-09-22T03:03:20.397841+0000","last_clean":"2024-09-22T03:03:20.397841+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:20.397841+0000","last_undegraded":"2024-09-22T03:03:20.397841+0000","last_fullsized":"2024-09-22T03:03:20.397841+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"17'1287","reported_seq":1300,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.315800+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:04:11.315800+0000","last_peered":"2024-09-22T03:04:11.315800+0000","last_clean":"2024-09-22T03:04:11.315800+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:04:11.315800+0000","last_undegraded":"2024-09-22T03:04:11.315800+0000","last_fullsized":"2024-09-22T03:04:11.315800+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1287,"log_dups_size":0,"ondisk_log_size":1287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84410368,"num_objects":1288,"num_object_clones":0,"num_object_copies":3864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":82432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.398509+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:20.398509+0000","last_peered":"2024-09-22T03:03:20.398509+0000","last_clean":"2024-09-22T03:03:20.398509+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:20.398509+0000","last_undegraded":"2024-09-22T03:03:20.398509+0000","last_fullsized":"2024-09-22T03:03:20.398509+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1381826560,"num_objects":21085,"num_object_clones":0,"num_object_copies":63255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21085,"num_write_kb":1349440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258830336,"data_stored":4141285376,"data_compressed":196647059,"data_compressed_allocated":258830336,"data_compressed_original":4141285376,"omap_allocated":0,"internal_metadata":0},"log_size":21069,"ondisk_log_size":21069,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673025,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128980,"kb_used_data":71620,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94242860,"statfs":{"total":96636764160,"available":96504688640,"internally_reserved":0,"allocated":73338880,"data_stored":1171104387,"data_compressed":55607365,"data_compressed_allocated":73191424,"data_compressed_original":1171062784,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673025,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":82780,"kb_used_data":55948,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94289060,"statfs":{"total":96636764160,"available":96551997440,"internally_reserved":0,"allocated":57290752,"data_stored":913941667,"data_compressed":43398040,"data_compressed_allocated":57122816,"data_compressed_original":913883136,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673025,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93184,"kb_used_data":62192,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94278656,"statfs":{"total":96636764160,"available":96541343744,"internally_reserved":0,"allocated":63684608,"data_stored":1016243363,"data_compressed":48255781,"data_compressed_allocated":63516672,"data_compressed_original":1016184832,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":90496,"kb_used_data":59504,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94281344,"statfs":{"total":96636764160,"available":96544096256,"internally_reserved":0,"allocated":60932096,"data_stored":972140889,"data_compressed":46161479,"data_compressed_allocated":60760064,"data_compressed_original":972079104,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61718528,"data_stored":987496448,"data_compressed":46890845,"data_compressed_allocated":61718528,"data_compressed_original":987496448,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":64561152,"data_stored":1032978432,"data_compressed":49050499,"data_compressed_allocated":64561152,"data_compressed_original":1032978432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58073088,"data_stored":929169408,"data_compressed":44121182,"data_compressed_allocated":58073088,"data_compressed_original":929169408,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":74477568,"data_stored":1191641088,"data_compressed":56584533,"data_compressed_allocated":74477568,"data_compressed_original":1191641088,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:16.582 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:16.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:16.731+0000 7f5b05e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:16.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:16.750+0000 7f5b04c01640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:16.872 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:17.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:17.021+0000 7f1bb9997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:17.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:17.034+0000 7f1bb9997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:17.052 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:04:17.052 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:04:17.070 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-09-22T03:04:16.095459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1382416947,"num_objects":21089,"num_object_clones":0,"num_object_copies":63267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":21224,"num_write_kb":1351336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21169,"ondisk_log_size":21169,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":395440,"kb_used_data":249264,"kb_used_omap":0,"kb_used_meta":146112,"kb_avail":377091920,"statfs":{"total":386547056640,"available":386142126080,"internally_reserved":0,"allocated":255246336,"data_stored":4073430306,"data_compressed":193422665,"data_compressed_allocated":254590976,"data_compressed_original":4073209856,"omap_allocated":0,"internal_metadata":149618688},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":118030336,"num_objects":1801,"num_object_clones":0,"num_object_copies":5403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1801,"num_write_kb":115264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.777886"},"pg_stats":[{"pgid":"3.f","version":"19'1392","reported_seq":1411,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:14.310111+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:04:14.310111+0000","last_peered":"2024-09-22T03:04:14.310111+0000","last_clean":"2024-09-22T03:04:14.310111+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:04:14.310111+0000","last_undegraded":"2024-09-22T03:04:14.310111+0000","last_fullsized":"2024-09-22T03:04:14.310111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1392,"log_dups_size":0,"ondisk_log_size":1392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91291648,"num_objects":1393,"num_object_clones":0,"num_object_copies":4179,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1393,"num_write_kb":89152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"17'1343","reported_seq":1356,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.262854+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:04:11.262854+0000","last_peered":"2024-09-22T03:04:11.262854+0000","last_clean":"2024-09-22T03:04:11.262854+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:04:11.262854+0000","last_undegraded":"2024-09-22T03:04:11.262854+0000","last_fullsized":"2024-09-22T03:04:11.262854+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1343,"log_dups_size":0,"ondisk_log_size":1343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":1344,"num_object_clones":0,"num_object_copies":4032,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1344,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"17'1273","reported_seq":1286,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.171903+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:04:11.171903+0000","last_peered":"2024-09-22T03:04:11.171903+0000","last_clean":"2024-09-22T03:04:11.171903+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:04:11.171903+0000","last_undegraded":"2024-09-22T03:04:11.171903+0000","last_fullsized":"2024-09-22T03:04:11.171903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1273,"log_dups_size":0,"ondisk_log_size":1273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83492864,"num_objects":1274,"num_object_clones":0,"num_object_copies":3822,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1274,"num_write_kb":81536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"19'1364","reported_seq":1383,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:14.243583+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:04:14.243583+0000","last_peered":"2024-09-22T03:04:14.243583+0000","last_clean":"2024-09-22T03:04:14.243583+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:04:14.243583+0000","last_undegraded":"2024-09-22T03:04:14.243583+0000","last_fullsized":"2024-09-22T03:04:14.243583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1364,"log_dups_size":0,"ondisk_log_size":1364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":89456640,"num_objects":1365,"num_object_clones":0,"num_object_copies":4095,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1365,"num_write_kb":87360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'1294","reported_seq":1307,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.245209+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:04:11.245209+0000","last_peered":"2024-09-22T03:04:11.245209+0000","last_clean":"2024-09-22T03:04:11.245209+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:04:11.245209+0000","last_undegraded":"2024-09-22T03:04:11.245209+0000","last_fullsized":"2024-09-22T03:04:11.245209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1294,"log_dups_size":0,"ondisk_log_size":1294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84869120,"num_objects":1295,"num_object_clones":0,"num_object_copies":3885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1295,"num_write_kb":82880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"19'1356","reported_seq":1375,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:14.140111+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:04:14.140111+0000","last_peered":"2024-09-22T03:04:14.140111+0000","last_clean":"2024-09-22T03:04:14.140111+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:04:14.140111+0000","last_undegraded":"2024-09-22T03:04:14.140111+0000","last_fullsized":"2024-09-22T03:04:14.140111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1356,"log_dups_size":0,"ondisk_log_size":1356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88932352,"num_objects":1357,"num_object_clones":0,"num_object_copies":4071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1357,"num_write_kb":86848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"19'1407","reported_seq":1426,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:14.287111+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:04:14.287111+0000","last_peered":"2024-09-22T03:04:14.287111+0000","last_clean":"2024-09-22T03:04:14.287111+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:04:14.287111+0000","last_undegraded":"2024-09-22T03:04:14.287111+0000","last_fullsized":"2024-09-22T03:04:14.287111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1407,"log_dups_size":0,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":1408,"num_object_clones":0,"num_object_copies":4224,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1408,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"17'1262","reported_seq":1275,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.292679+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:04:11.292679+0000","last_peered":"2024-09-22T03:04:11.292679+0000","last_clean":"2024-09-22T03:04:11.292679+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:04:11.292679+0000","last_undegraded":"2024-09-22T03:04:11.292679+0000","last_fullsized":"2024-09-22T03:04:11.292679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1262,"log_dups_size":0,"ondisk_log_size":1262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82771968,"num_objects":1263,"num_object_clones":0,"num_object_copies":3789,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1263,"num_write_kb":80832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.389604+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:03:20.389604+0000","last_peered":"2024-09-22T03:03:20.389604+0000","last_clean":"2024-09-22T03:03:20.389604+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:03:20.389604+0000","last_undegraded":"2024-09-22T03:03:20.389604+0000","last_fullsized":"2024-09-22T03:03:20.389604+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"17'1319","reported_seq":1332,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.275195+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:04:11.275195+0000","last_peered":"2024-09-22T03:04:11.275195+0000","last_clean":"2024-09-22T03:04:11.275195+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:04:11.275195+0000","last_undegraded":"2024-09-22T03:04:11.275195+0000","last_fullsized":"2024-09-22T03:04:11.275195+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1319,"log_dups_size":0,"ondisk_log_size":1319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":86507520,"num_objects":1320,"num_object_clones":0,"num_object_copies":3960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1320,"num_write_kb":84480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":31,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:14.091653+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:14.091653+0000","last_peered":"2024-09-22T03:04:14.091653+0000","last_clean":"2024-09-22T03:04:14.091653+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:14.091653+0000","last_undegraded":"2024-09-22T03:04:14.091653+0000","last_fullsized":"2024-09-22T03:04:14.091653+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"17'1201","reported_seq":1214,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.339267+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:04:11.339267+0000","last_peered":"2024-09-22T03:04:11.339267+0000","last_clean":"2024-09-22T03:04:11.339267+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:04:11.339267+0000","last_undegraded":"2024-09-22T03:04:11.339267+0000","last_fullsized":"2024-09-22T03:04:11.339267+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1201,"log_dups_size":0,"ondisk_log_size":1201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":78774272,"num_objects":1202,"num_object_clones":0,"num_object_copies":3606,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1202,"num_write_kb":76928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":27,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.388644+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:03:20.388644+0000","last_peered":"2024-09-22T03:03:20.388644+0000","last_clean":"2024-09-22T03:03:20.388644+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:03:20.388644+0000","last_undegraded":"2024-09-22T03:03:20.388644+0000","last_fullsized":"2024-09-22T03:03:20.388644+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"17'1333","reported_seq":1346,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.296227+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:04:11.296227+0000","last_peered":"2024-09-22T03:04:11.296227+0000","last_clean":"2024-09-22T03:04:11.296227+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:04:11.296227+0000","last_undegraded":"2024-09-22T03:04:11.296227+0000","last_fullsized":"2024-09-22T03:04:11.296227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1333,"log_dups_size":0,"ondisk_log_size":1333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87425024,"num_objects":1334,"num_object_clones":0,"num_object_copies":4002,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1334,"num_write_kb":85376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":26,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.393994+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:03:20.393994+0000","last_peered":"2024-09-22T03:03:20.393994+0000","last_clean":"2024-09-22T03:03:20.393994+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:03:20.393994+0000","last_undegraded":"2024-09-22T03:03:20.393994+0000","last_fullsized":"2024-09-22T03:03:20.393994+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":157,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-22T03:04:14.097011+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:14.097011+0000","last_peered":"2024-09-22T03:04:14.097011+0000","last_clean":"2024-09-22T03:04:14.097011+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:14.097011+0000","last_undegraded":"2024-09-22T03:04:14.097011+0000","last_fullsized":"2024-09-22T03:04:14.097011+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"17'1387","reported_seq":1400,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.299593+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:04:11.299593+0000","last_peered":"2024-09-22T03:04:11.299593+0000","last_clean":"2024-09-22T03:04:11.299593+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:04:11.299593+0000","last_undegraded":"2024-09-22T03:04:11.299593+0000","last_fullsized":"2024-09-22T03:04:11.299593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1387,"log_dups_size":0,"ondisk_log_size":1387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90963968,"num_objects":1388,"num_object_clones":0,"num_object_copies":4164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1388,"num_write_kb":88832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1251","reported_seq":1264,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.229799+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:04:11.229799+0000","last_peered":"2024-09-22T03:04:11.229799+0000","last_clean":"2024-09-22T03:04:11.229799+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:04:11.229799+0000","last_undegraded":"2024-09-22T03:04:11.229799+0000","last_fullsized":"2024-09-22T03:04:11.229799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1251,"log_dups_size":0,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82051072,"num_objects":1252,"num_object_clones":0,"num_object_copies":3756,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1252,"num_write_kb":80128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392562+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:03:20.392562+0000","last_peered":"2024-09-22T03:03:20.392562+0000","last_clean":"2024-09-22T03:03:20.392562+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:03:20.392562+0000","last_undegraded":"2024-09-22T03:03:20.392562+0000","last_fullsized":"2024-09-22T03:03:20.392562+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"17'1336","reported_seq":1349,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.317415+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:04:11.317415+0000","last_peered":"2024-09-22T03:04:11.317415+0000","last_clean":"2024-09-22T03:04:11.317415+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:04:11.317415+0000","last_undegraded":"2024-09-22T03:04:11.317415+0000","last_fullsized":"2024-09-22T03:04:11.317415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1336,"log_dups_size":0,"ondisk_log_size":1336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87621632,"num_objects":1337,"num_object_clones":0,"num_object_copies":4011,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1337,"num_write_kb":85568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.392946+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:03:20.392946+0000","last_peered":"2024-09-22T03:03:20.392946+0000","last_clean":"2024-09-22T03:03:20.392946+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:03:20.392946+0000","last_undegraded":"2024-09-22T03:03:20.392946+0000","last_fullsized":"2024-09-22T03:03:20.392946+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"17'1264","reported_seq":1277,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.293253+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:04:11.293253+0000","last_peered":"2024-09-22T03:04:11.293253+0000","last_clean":"2024-09-22T03:04:11.293253+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:04:11.293253+0000","last_undegraded":"2024-09-22T03:04:11.293253+0000","last_fullsized":"2024-09-22T03:04:11.293253+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":82903040,"num_objects":1265,"num_object_clones":0,"num_object_copies":3795,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1265,"num_write_kb":80960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.397841+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:03:20.397841+0000","last_peered":"2024-09-22T03:03:20.397841+0000","last_clean":"2024-09-22T03:03:20.397841+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:03:20.397841+0000","last_undegraded":"2024-09-22T03:03:20.397841+0000","last_fullsized":"2024-09-22T03:03:20.397841+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"17'1287","reported_seq":1300,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:04:11.315800+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:04:11.315800+0000","last_peered":"2024-09-22T03:04:11.315800+0000","last_clean":"2024-09-22T03:04:11.315800+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:04:11.315800+0000","last_undegraded":"2024-09-22T03:04:11.315800+0000","last_fullsized":"2024-09-22T03:04:11.315800+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1287,"log_dups_size":0,"ondisk_log_size":1287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84410368,"num_objects":1288,"num_object_clones":0,"num_object_copies":3864,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1288,"num_write_kb":82432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":25,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-22T03:03:20.398509+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:03:20.398509+0000","last_peered":"2024-09-22T03:03:20.398509+0000","last_clean":"2024-09-22T03:03:20.398509+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:03:20.398509+0000","last_undegraded":"2024-09-22T03:03:20.398509+0000","last_fullsized":"2024-09-22T03:03:20.398509+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1381826560,"num_objects":21085,"num_object_clones":0,"num_object_copies":63255,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21085,"num_write_kb":1349440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258830336,"data_stored":4141285376,"data_compressed":196647059,"data_compressed_allocated":258830336,"data_compressed_original":4141285376,"omap_allocated":0,"internal_metadata":0},"log_size":21069,"ondisk_log_size":21069,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673025,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128980,"kb_used_data":71620,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94242860,"statfs":{"total":96636764160,"available":96504688640,"internally_reserved":0,"allocated":73338880,"data_stored":1171104387,"data_compressed":55607365,"data_compressed_allocated":73191424,"data_compressed_original":1171062784,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673025,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":82780,"kb_used_data":55948,"kb_used_omap":0,"kb_used_meta":26816,"kb_avail":94289060,"statfs":{"total":96636764160,"available":96551997440,"internally_reserved":0,"allocated":57290752,"data_stored":913941667,"data_compressed":43398040,"data_compressed_allocated":57122816,"data_compressed_original":913883136,"omap_allocated":0,"internal_metadata":27459584},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673025,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93184,"kb_used_data":62192,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94278656,"statfs":{"total":96636764160,"available":96541343744,"internally_reserved":0,"allocated":63684608,"data_stored":1016243363,"data_compressed":48255781,"data_compressed_allocated":63516672,"data_compressed_original":1016184832,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705733,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":90496,"kb_used_data":59504,"kb_used_omap":0,"kb_used_meta":30976,"kb_avail":94281344,"statfs":{"total":96636764160,"available":96544096256,"internally_reserved":0,"allocated":60932096,"data_stored":972140889,"data_compressed":46161479,"data_compressed_allocated":60760064,"data_compressed_original":972079104,"omap_allocated":0,"internal_metadata":31719424},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61718528,"data_stored":987496448,"data_compressed":46890845,"data_compressed_allocated":61718528,"data_compressed_original":987496448,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":64561152,"data_stored":1032978432,"data_compressed":49050499,"data_compressed_allocated":64561152,"data_compressed_original":1032978432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":58073088,"data_stored":929169408,"data_compressed":44121182,"data_compressed_allocated":58073088,"data_compressed_original":929169408,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":74477568,"data_stored":1191641088,"data_compressed":56584533,"data_compressed_allocated":74477568,"data_compressed_original":1191641088,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:17.072 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:04:17.072 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:17.072 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:04:17.072 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:04:17.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:17.215+0000 7f855c26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:17.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:17.231+0000 7f855c26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:17.290 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:17.290 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:04:17.290 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:04:17.290 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:04:17.290 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:04:17.290 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:04:17.290 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:04:17.290 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:04:17.290 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:04:17.291 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:04:17.291 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:04:17.291 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:04:17.293 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:17.293 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:17.294 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:04:17.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 57 16 22893 22877 25.0809 20.0625 0.0533911 0.0398388 2024-09-22T03:04:17.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:17.489+0000 7f7ede197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:17.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:17.505+0000 7f7ede197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:17.556 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:17.556 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:04:17.556 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:04:17.556 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:04:17.556 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:04:17.556 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:04:17.556 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:04:17.556 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:04:17.556 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:04:17.556 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:04:17.556 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:04:17.556 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:04:17.560 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:17.561 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:17.561 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:04:17.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:17.708+0000 7ff6180ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:17.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:17.722+0000 7ff6180ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:17.744 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:17.744 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:04:17.744 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:04:17.744 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:04:17.744 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:04:17.744 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:04:17.745 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:04:17.745 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:04:17.745 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:04:17.745 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:04:17.745 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:04:17.745 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:04:17.748 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:17.748 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:17.748 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:04:17.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:17.895+0000 7f037c8ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:17.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:17.910+0000 7f037c8ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:17.936 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:17.936 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:04:17.936 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:04:17.936 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:04:17.936 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:04:17.936 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:04:17.936 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:04:17.936 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:04:17.936 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:04:17.936 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:04:17.936 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:04:17.936 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:04:17.940 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:17.941 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:18.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 58 16 23230 23214 25.0116 21.0625 0.0371183 0.0399618 2024-09-22T03:04:19.280 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:19.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:19.428+0000 7fec7b197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:19.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:19.436+0000 7fec7b197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:19.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 59 16 23585 23569 24.9637 22.1875 0.0622599 0.0400334 2024-09-22T03:04:20.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:2024-09-22T03:04:20.479589+0000 min lat: 0.009172 max lat: 0.138644 avg lat: 0.0401209 2024-09-22T03:04:20.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:04:20.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 60 16 23932 23916 24.9091 21.6875 0.0526789 0.0401209 2024-09-22T03:04:21.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 61 16 24283 24267 24.8603 21.9375 0.0495532 0.0402032 2024-09-22T03:04:21.649 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:21.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:21.805+0000 7fdb18618640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:21.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:21.813+0000 7fdb18618640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:22.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 62 16 24625 24609 24.8041 21.375 0.0369929 0.0402929 2024-09-22T03:04:22.941 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:22.942 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:22.942 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:23.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:23.095+0000 7f7f53efa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:23.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:23.106+0000 7f7f53efa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:23.436 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:04:23.437 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:04:23.458 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-09-22T03:04:23.319637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1577386547,"num_objects":24064,"num_object_clones":0,"num_object_copies":72192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":24199,"num_write_kb":1541736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24144,"ondisk_log_size":24144,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":492972,"kb_used_data":285736,"kb_used_omap":0,"kb_used_meta":207168,"kb_avail":376994388,"statfs":{"total":386547056640,"available":386042253312,"internally_reserved":0,"allocated":292593664,"data_stored":4669070569,"data_compressed":221704518,"data_compressed_allocated":291815424,"data_compressed_original":4668801024,"omap_allocated":0,"internal_metadata":212140032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":194969600,"num_objects":2975,"num_object_clones":0,"num_object_copies":8925,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2975,"num_write_kb":190400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.230917"},"pg_stats":[{"pgid":"3.f","version":"21'1491","reported_seq":1516,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:19.146892+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:04:19.146892+0000","last_peered":"2024-09-22T03:04:19.146892+0000","last_clean":"2024-09-22T03:04:19.146892+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:04:19.146892+0000","last_undegraded":"2024-09-22T03:04:19.146892+0000","last_fullsized":"2024-09-22T03:04:19.146892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1491,"log_dups_size":0,"ondisk_log_size":1491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97779712,"num_objects":1492,"num_object_clones":0,"num_object_copies":4476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1492,"num_write_kb":95488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"21'1550","reported_seq":1575,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.333873+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:04:21.333873+0000","last_peered":"2024-09-22T03:04:21.333873+0000","last_clean":"2024-09-22T03:04:21.333873+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:04:21.333873+0000","last_undegraded":"2024-09-22T03:04:21.333873+0000","last_fullsized":"2024-09-22T03:04:21.333873+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1550,"log_dups_size":0,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101646336,"num_objects":1551,"num_object_clones":0,"num_object_copies":4653,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1551,"num_write_kb":99264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"21'1467","reported_seq":1492,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.329887+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:04:21.329887+0000","last_peered":"2024-09-22T03:04:21.329887+0000","last_clean":"2024-09-22T03:04:21.329887+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:04:21.329887+0000","last_undegraded":"2024-09-22T03:04:21.329887+0000","last_fullsized":"2024-09-22T03:04:21.329887+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1467,"log_dups_size":0,"ondisk_log_size":1467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96206848,"num_objects":1468,"num_object_clones":0,"num_object_copies":4404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1468,"num_write_kb":93952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'1478","reported_seq":1503,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:19.133574+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:04:19.133574+0000","last_peered":"2024-09-22T03:04:19.133574+0000","last_clean":"2024-09-22T03:04:19.133574+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:04:19.133574+0000","last_undegraded":"2024-09-22T03:04:19.133574+0000","last_fullsized":"2024-09-22T03:04:19.133574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1478,"log_dups_size":0,"ondisk_log_size":1478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96927744,"num_objects":1479,"num_object_clones":0,"num_object_copies":4437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1479,"num_write_kb":94656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"21'1491","reported_seq":1516,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.283409+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:04:21.283409+0000","last_peered":"2024-09-22T03:04:21.283409+0000","last_clean":"2024-09-22T03:04:21.283409+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:04:21.283409+0000","last_undegraded":"2024-09-22T03:04:21.283409+0000","last_fullsized":"2024-09-22T03:04:21.283409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1491,"log_dups_size":0,"ondisk_log_size":1491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97779712,"num_objects":1492,"num_object_clones":0,"num_object_copies":4476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1492,"num_write_kb":95488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'1461","reported_seq":1486,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:19.257821+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:04:19.257821+0000","last_peered":"2024-09-22T03:04:19.257821+0000","last_clean":"2024-09-22T03:04:19.257821+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:04:19.257821+0000","last_undegraded":"2024-09-22T03:04:19.257821+0000","last_fullsized":"2024-09-22T03:04:19.257821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1461,"log_dups_size":0,"ondisk_log_size":1461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95813632,"num_objects":1462,"num_object_clones":0,"num_object_copies":4386,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1462,"num_write_kb":93568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'1524","reported_seq":1549,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:19.233964+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:04:19.233964+0000","last_peered":"2024-09-22T03:04:19.233964+0000","last_clean":"2024-09-22T03:04:19.233964+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:04:19.233964+0000","last_undegraded":"2024-09-22T03:04:19.233964+0000","last_fullsized":"2024-09-22T03:04:19.233964+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1524,"log_dups_size":0,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99942400,"num_objects":1525,"num_object_clones":0,"num_object_copies":4575,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1525,"num_write_kb":97600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"21'1485","reported_seq":1510,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.209223+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:04:21.209223+0000","last_peered":"2024-09-22T03:04:21.209223+0000","last_clean":"2024-09-22T03:04:21.209223+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:04:21.209223+0000","last_undegraded":"2024-09-22T03:04:21.209223+0000","last_fullsized":"2024-09-22T03:04:21.209223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1485,"log_dups_size":0,"ondisk_log_size":1485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97386496,"num_objects":1486,"num_object_clones":0,"num_object_copies":4458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":95104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.115563+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:16.115563+0000","last_peered":"2024-09-22T03:04:16.115563+0000","last_clean":"2024-09-22T03:04:16.115563+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:16.115563+0000","last_undegraded":"2024-09-22T03:04:16.115563+0000","last_fullsized":"2024-09-22T03:04:16.115563+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"21'1551","reported_seq":1576,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.315430+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:04:21.315430+0000","last_peered":"2024-09-22T03:04:21.315430+0000","last_clean":"2024-09-22T03:04:21.315430+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:04:21.315430+0000","last_undegraded":"2024-09-22T03:04:21.315430+0000","last_fullsized":"2024-09-22T03:04:21.315430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1551,"log_dups_size":0,"ondisk_log_size":1551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101711872,"num_objects":1552,"num_object_clones":0,"num_object_copies":4656,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1552,"num_write_kb":99328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.139836+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:16.139836+0000","last_peered":"2024-09-22T03:04:16.139836+0000","last_clean":"2024-09-22T03:04:16.139836+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:16.139836+0000","last_undegraded":"2024-09-22T03:04:16.139836+0000","last_fullsized":"2024-09-22T03:04:16.139836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"21'1411","reported_seq":1436,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.299004+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:04:21.299004+0000","last_peered":"2024-09-22T03:04:21.299004+0000","last_clean":"2024-09-22T03:04:21.299004+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:04:21.299004+0000","last_undegraded":"2024-09-22T03:04:21.299004+0000","last_fullsized":"2024-09-22T03:04:21.299004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1411,"log_dups_size":0,"ondisk_log_size":1411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92536832,"num_objects":1412,"num_object_clones":0,"num_object_copies":4236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1412,"num_write_kb":90368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":39,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.112960+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:16.112960+0000","last_peered":"2024-09-22T03:04:16.112960+0000","last_clean":"2024-09-22T03:04:16.112960+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:16.112960+0000","last_undegraded":"2024-09-22T03:04:16.112960+0000","last_fullsized":"2024-09-22T03:04:16.112960+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'1534","reported_seq":1559,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.317205+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:04:21.317205+0000","last_peered":"2024-09-22T03:04:21.317205+0000","last_clean":"2024-09-22T03:04:21.317205+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:04:21.317205+0000","last_undegraded":"2024-09-22T03:04:21.317205+0000","last_fullsized":"2024-09-22T03:04:21.317205+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1534,"log_dups_size":0,"ondisk_log_size":1534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100597760,"num_objects":1535,"num_object_clones":0,"num_object_copies":4605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1535,"num_write_kb":98240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":38,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.117316+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:16.117316+0000","last_peered":"2024-09-22T03:04:16.117316+0000","last_clean":"2024-09-22T03:04:16.117316+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:16.117316+0000","last_undegraded":"2024-09-22T03:04:16.117316+0000","last_fullsized":"2024-09-22T03:04:16.117316+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.137340+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:16.137340+0000","last_peered":"2024-09-22T03:04:16.137340+0000","last_clean":"2024-09-22T03:04:16.137340+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:16.137340+0000","last_undegraded":"2024-09-22T03:04:16.137340+0000","last_fullsized":"2024-09-22T03:04:16.137340+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"21'1600","reported_seq":1625,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.293123+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:04:21.293123+0000","last_peered":"2024-09-22T03:04:21.293123+0000","last_clean":"2024-09-22T03:04:21.293123+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:04:21.293123+0000","last_undegraded":"2024-09-22T03:04:21.293123+0000","last_fullsized":"2024-09-22T03:04:21.293123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1600,"log_dups_size":0,"ondisk_log_size":1600,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104923136,"num_objects":1601,"num_object_clones":0,"num_object_copies":4803,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1601,"num_write_kb":102464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"21'1470","reported_seq":1495,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.182573+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:04:21.182573+0000","last_peered":"2024-09-22T03:04:21.182573+0000","last_clean":"2024-09-22T03:04:21.182573+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:04:21.182573+0000","last_undegraded":"2024-09-22T03:04:21.182573+0000","last_fullsized":"2024-09-22T03:04:21.182573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1470,"log_dups_size":0,"ondisk_log_size":1470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96403456,"num_objects":1471,"num_object_clones":0,"num_object_copies":4413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1471,"num_write_kb":94144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.122353+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:16.122353+0000","last_peered":"2024-09-22T03:04:16.122353+0000","last_clean":"2024-09-22T03:04:16.122353+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:16.122353+0000","last_undegraded":"2024-09-22T03:04:16.122353+0000","last_fullsized":"2024-09-22T03:04:16.122353+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"21'1542","reported_seq":1567,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.325200+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:04:21.325200+0000","last_peered":"2024-09-22T03:04:21.325200+0000","last_clean":"2024-09-22T03:04:21.325200+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:04:21.325200+0000","last_undegraded":"2024-09-22T03:04:21.325200+0000","last_fullsized":"2024-09-22T03:04:21.325200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1542,"log_dups_size":0,"ondisk_log_size":1542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101122048,"num_objects":1543,"num_object_clones":0,"num_object_copies":4629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1543,"num_write_kb":98752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.116471+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:16.116471+0000","last_peered":"2024-09-22T03:04:16.116471+0000","last_clean":"2024-09-22T03:04:16.116471+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:16.116471+0000","last_undegraded":"2024-09-22T03:04:16.116471+0000","last_fullsized":"2024-09-22T03:04:16.116471+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"21'1485","reported_seq":1510,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.253011+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:04:21.253011+0000","last_peered":"2024-09-22T03:04:21.253011+0000","last_clean":"2024-09-22T03:04:21.253011+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:04:21.253011+0000","last_undegraded":"2024-09-22T03:04:21.253011+0000","last_fullsized":"2024-09-22T03:04:21.253011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1485,"log_dups_size":0,"ondisk_log_size":1485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97386496,"num_objects":1486,"num_object_clones":0,"num_object_copies":4458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1486,"num_write_kb":95104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.124834+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:16.124834+0000","last_peered":"2024-09-22T03:04:16.124834+0000","last_clean":"2024-09-22T03:04:16.124834+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:16.124834+0000","last_undegraded":"2024-09-22T03:04:16.124834+0000","last_fullsized":"2024-09-22T03:04:16.124834+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'1504","reported_seq":1529,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:21.231712+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:04:21.231712+0000","last_peered":"2024-09-22T03:04:21.231712+0000","last_clean":"2024-09-22T03:04:21.231712+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:04:21.231712+0000","last_undegraded":"2024-09-22T03:04:21.231712+0000","last_fullsized":"2024-09-22T03:04:21.231712+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1504,"log_dups_size":0,"ondisk_log_size":1504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98631680,"num_objects":1505,"num_object_clones":0,"num_object_copies":4515,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1505,"num_write_kb":96320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.126695+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:16.126695+0000","last_peered":"2024-09-22T03:04:16.126695+0000","last_clean":"2024-09-22T03:04:16.126695+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:16.126695+0000","last_undegraded":"2024-09-22T03:04:16.126695+0000","last_fullsized":"2024-09-22T03:04:16.126695+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1576796160,"num_objects":24060,"num_object_clones":0,"num_object_copies":72180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24060,"num_write_kb":1539840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":295800832,"data_stored":4732813312,"data_compressed":224735968,"data_compressed_allocated":295800832,"data_compressed_original":4732813312,"omap_allocated":0,"internal_metadata":0},"log_size":24044,"ondisk_log_size":24044,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":136860,"kb_used_data":83660,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94234980,"statfs":{"total":96636764160,"available":96496619520,"internally_reserved":0,"allocated":85667840,"data_stored":1367856551,"data_compressed":64949588,"data_compressed_allocated":85487616,"data_compressed_original":1367801856,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":122848,"kb_used_data":65488,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94248992,"statfs":{"total":96636764160,"available":96510967808,"internally_reserved":0,"allocated":67059712,"data_stored":1069733831,"data_compressed":50795264,"data_compressed_allocated":66859008,"data_compressed_original":1069662208,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134028,"kb_used_data":72504,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94237812,"statfs":{"total":96636764160,"available":96499519488,"internally_reserved":0,"allocated":74244096,"data_stored":1184683975,"data_compressed":56253620,"data_compressed_allocated":74043392,"data_compressed_original":1184612352,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99236,"kb_used_data":64084,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94272604,"statfs":{"total":96636764160,"available":96535146496,"internally_reserved":0,"allocated":65622016,"data_stored":1046796212,"data_compressed":49706046,"data_compressed_allocated":65425408,"data_compressed_original":1046724608,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":66342912,"data_stored":1061486592,"data_compressed":50404292,"data_compressed_allocated":66342912,"data_compressed_original":1061486592,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":75079680,"data_stored":1201274880,"data_compressed":57042114,"data_compressed_allocated":75079680,"data_compressed_original":1201274880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":67731456,"data_stored":1083703296,"data_compressed":51459278,"data_compressed_allocated":67731456,"data_compressed_original":1083703296,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86646784,"data_stored":1386348544,"data_compressed":65830284,"data_compressed_allocated":86646784,"data_compressed_original":1386348544,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:23.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 63 16 24954 24938 24.7368 20.5625 0.0787922 0.0403987 2024-09-22T03:04:24.122 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:24.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:24.272+0000 7f8b54117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:24.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:24.280+0000 7f8b54117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:24.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 64 16 25289 25273 24.6774 20.9375 0.0380791 0.0404967 2024-09-22T03:04:25.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 65 16 25625 25609 24.6208 21 0.0431259 0.0405932 2024-09-22T03:04:26.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 66 16 25973 25957 24.5773 21.75 0.0293005 0.0406669 2024-09-22T03:04:26.593 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:26.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:26.744+0000 7fb713f4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:26.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:26.750+0000 7fb713f4e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:27.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 67 16 26300 26284 24.5154 20.4375 0.0551935 0.0407674 2024-09-22T03:04:28.460 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:28.460 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:28.460 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:04:28.460 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:04:28.481 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 68 16 26627 26611 24.4555 20.4375 0.0703275 0.0408675 2024-09-22T03:04:28.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:28.603+0000 7fa884623640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:28.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:28.615+0000 7fa884623640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:04:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:04:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:04:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:04:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:04:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:04:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:04:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:04:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:04:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:04:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:04:28.641 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:28.641 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:28.641 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:04:28.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:28.834+0000 7fb93dc58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:28.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:28.850+0000 7fb93dc58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:28.902 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:28.902 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:04:28.902 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:04:28.902 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:04:28.902 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:04:28.902 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:04:28.902 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:04:28.902 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:04:28.902 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:04:28.902 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:04:28.903 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:04:28.903 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:04:28.907 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:28.908 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:28.908 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:04:29.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:29.055+0000 7f5525317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:29.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:29.068+0000 7f5525317640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:04:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:04:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:04:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:04:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:04:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:04:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:04:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:04:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:04:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:04:29.093 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:04:29.095 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:29.096 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:29.096 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:29.096 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:04:29.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:29.269+0000 7ff0a7197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:29.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:29.277+0000 7ff0a7197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:29.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:29.286+0000 7f84c446c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:29.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:29.302+0000 7f84c446c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:04:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:04:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:04:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:04:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:04:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:04:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:04:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:04:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:04:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:04:29.341 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:04:29.346 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:29.346 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:29.480 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 69 16 26930 26914 24.3755 18.9375 0.0456213 0.0410027 2024-09-22T03:04:30.481 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 70 16 27268 27252 24.329 21.125 0.0413685 0.0410831 2024-09-22T03:04:31.477 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:31.481 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 71 16 27605 27589 24.283 21.0625 0.0627315 0.0411641 2024-09-22T03:04:31.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:31.629+0000 7fc574397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:31.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:31.635+0000 7fc574397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:32.481 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 72 15 27920 27905 24.22 19.75 0.0482158 0.041268 2024-09-22T03:04:33.481 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 73 16 28250 28234 24.1699 20.5625 0.0644422 0.0413551 2024-09-22T03:04:33.927 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:34.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:34.072+0000 7f55e7e23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:34.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:34.079+0000 7f55e7e23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:34.348 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:34.348 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:04:34.481 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 74 16 28570 28554 24.1135 20 0.0744781 0.0414526 2024-09-22T03:04:34.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:34.498+0000 7fed0aa58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:34.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:34.510+0000 7fed0aa58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:35.392 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:04:35.414 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:04:35.481 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 75 16 28883 28867 24.0528 19.5625 0.0441851 0.041557 2024-09-22T03:04:35.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:35.608+0000 7fa0aa797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:35.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:35.624+0000 7fa0aa797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:36.393 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:04:36.419 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:04:36.446 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:36.481 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 76 16 29188 29172 23.9871 19.0625 0.0449962 0.0416677 2024-09-22T03:04:36.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:36.607+0000 7fcf58263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:36.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:36.622+0000 7fcf58263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:36.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:36.625+0000 7f12a5797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:36.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:36.641+0000 7f12a5797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:37.403 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:04:37.423 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:04:37.481 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 77 16 29484 29468 23.9158 18.5 0.0446861 0.0417925 2024-09-22T03:04:37.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:37.579+0000 7ff10242c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:37.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:37.595+0000 7ff10242c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:38.409 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:04:38.427 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:04:38.427 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:38.481 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 78 16 29773 29757 23.8408 18.0625 0.0758895 0.0419262 2024-09-22T03:04:38.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:38.573+0000 7f1abbe2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:38.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:38.587+0000 7f1abbe2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:38.892 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:04:38.893 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:04:38.894 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:38.910 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-09-22T03:04:38.409124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1900151347,"num_objects":28989,"num_object_clones":0,"num_object_copies":86967,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":29124,"num_write_kb":1856936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29069,"ondisk_log_size":29069,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":558292,"kb_used_data":345484,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":376929068,"statfs":{"total":386547056640,"available":385975365632,"internally_reserved":0,"allocated":353775616,"data_stored":5647726203,"data_compressed":268176014,"data_compressed_allocated":352980992,"data_compressed_original":5647450112,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":104005632,"num_objects":1587,"num_object_clones":0,"num_object_copies":4761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1587,"num_write_kb":101568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.087549"},"pg_stats":[{"pgid":"3.f","version":"21'1795","reported_seq":1820,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.213583+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:04:34.213583+0000","last_peered":"2024-09-22T03:04:34.213583+0000","last_clean":"2024-09-22T03:04:34.213583+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:04:34.213583+0000","last_undegraded":"2024-09-22T03:04:34.213583+0000","last_fullsized":"2024-09-22T03:04:34.213583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1795,"log_dups_size":0,"ondisk_log_size":1795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117702656,"num_objects":1796,"num_object_clones":0,"num_object_copies":5388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1796,"num_write_kb":114944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"22'1859","reported_seq":1887,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.307715+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:04:36.307715+0000","last_peered":"2024-09-22T03:04:36.307715+0000","last_clean":"2024-09-22T03:04:36.307715+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:04:36.307715+0000","last_undegraded":"2024-09-22T03:04:36.307715+0000","last_fullsized":"2024-09-22T03:04:36.307715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1859,"log_dups_size":0,"ondisk_log_size":1859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121896960,"num_objects":1860,"num_object_clones":0,"num_object_copies":5580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1860,"num_write_kb":119040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1780","reported_seq":1808,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.310184+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:04:36.310184+0000","last_peered":"2024-09-22T03:04:36.310184+0000","last_clean":"2024-09-22T03:04:36.310184+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:04:36.310184+0000","last_undegraded":"2024-09-22T03:04:36.310184+0000","last_fullsized":"2024-09-22T03:04:36.310184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1780,"log_dups_size":0,"ondisk_log_size":1780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116719616,"num_objects":1781,"num_object_clones":0,"num_object_copies":5343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1781,"num_write_kb":113984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'1780","reported_seq":1805,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.241860+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:04:34.241860+0000","last_peered":"2024-09-22T03:04:34.241860+0000","last_clean":"2024-09-22T03:04:34.241860+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:04:34.241860+0000","last_undegraded":"2024-09-22T03:04:34.241860+0000","last_fullsized":"2024-09-22T03:04:34.241860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1780,"log_dups_size":0,"ondisk_log_size":1780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116719616,"num_objects":1781,"num_object_clones":0,"num_object_copies":5343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1781,"num_write_kb":113984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'1805","reported_seq":1833,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.232334+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:04:36.232334+0000","last_peered":"2024-09-22T03:04:36.232334+0000","last_clean":"2024-09-22T03:04:36.232334+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:04:36.232334+0000","last_undegraded":"2024-09-22T03:04:36.232334+0000","last_fullsized":"2024-09-22T03:04:36.232334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1805,"log_dups_size":0,"ondisk_log_size":1805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118358016,"num_objects":1806,"num_object_clones":0,"num_object_copies":5418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1806,"num_write_kb":115584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'1787","reported_seq":1812,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.172453+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:04:34.172453+0000","last_peered":"2024-09-22T03:04:34.172453+0000","last_clean":"2024-09-22T03:04:34.172453+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:04:34.172453+0000","last_undegraded":"2024-09-22T03:04:34.172453+0000","last_fullsized":"2024-09-22T03:04:34.172453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1787,"log_dups_size":0,"ondisk_log_size":1787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117178368,"num_objects":1788,"num_object_clones":0,"num_object_copies":5364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1788,"num_write_kb":114432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'1833","reported_seq":1858,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.285726+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:04:34.285726+0000","last_peered":"2024-09-22T03:04:34.285726+0000","last_clean":"2024-09-22T03:04:34.285726+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:04:34.285726+0000","last_undegraded":"2024-09-22T03:04:34.285726+0000","last_fullsized":"2024-09-22T03:04:34.285726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1833,"log_dups_size":0,"ondisk_log_size":1833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120193024,"num_objects":1834,"num_object_clones":0,"num_object_copies":5502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1834,"num_write_kb":117376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"22'1789","reported_seq":1817,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.276185+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:04:36.276185+0000","last_peered":"2024-09-22T03:04:36.276185+0000","last_clean":"2024-09-22T03:04:36.276185+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:04:36.276185+0000","last_undegraded":"2024-09-22T03:04:36.276185+0000","last_fullsized":"2024-09-22T03:04:36.276185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117309440,"num_objects":1790,"num_object_clones":0,"num_object_copies":5370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1790,"num_write_kb":114560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.420351+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:35.420351+0000","last_peered":"2024-09-22T03:04:35.420351+0000","last_clean":"2024-09-22T03:04:35.420351+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:35.420351+0000","last_undegraded":"2024-09-22T03:04:35.420351+0000","last_fullsized":"2024-09-22T03:04:35.420351+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"22'1832","reported_seq":1860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.273716+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:04:36.273716+0000","last_peered":"2024-09-22T03:04:36.273716+0000","last_clean":"2024-09-22T03:04:36.273716+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:04:36.273716+0000","last_undegraded":"2024-09-22T03:04:36.273716+0000","last_fullsized":"2024-09-22T03:04:36.273716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1832,"log_dups_size":0,"ondisk_log_size":1832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120127488,"num_objects":1833,"num_object_clones":0,"num_object_copies":5499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":117312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.139836+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:16.139836+0000","last_peered":"2024-09-22T03:04:16.139836+0000","last_clean":"2024-09-22T03:04:16.139836+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:16.139836+0000","last_undegraded":"2024-09-22T03:04:16.139836+0000","last_fullsized":"2024-09-22T03:04:16.139836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"22'1735","reported_seq":1763,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.148210+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:04:36.148210+0000","last_peered":"2024-09-22T03:04:36.148210+0000","last_clean":"2024-09-22T03:04:36.148210+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:04:36.148210+0000","last_undegraded":"2024-09-22T03:04:36.148210+0000","last_fullsized":"2024-09-22T03:04:36.148210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":0,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113770496,"num_objects":1736,"num_object_clones":0,"num_object_copies":5208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1736,"num_write_kb":111104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.421112+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:35.421112+0000","last_peered":"2024-09-22T03:04:35.421112+0000","last_clean":"2024-09-22T03:04:35.421112+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:35.421112+0000","last_undegraded":"2024-09-22T03:04:35.421112+0000","last_fullsized":"2024-09-22T03:04:35.421112+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'1851","reported_seq":1879,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.277468+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:04:36.277468+0000","last_peered":"2024-09-22T03:04:36.277468+0000","last_clean":"2024-09-22T03:04:36.277468+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:04:36.277468+0000","last_undegraded":"2024-09-22T03:04:36.277468+0000","last_fullsized":"2024-09-22T03:04:36.277468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1851,"log_dups_size":0,"ondisk_log_size":1851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121372672,"num_objects":1852,"num_object_clones":0,"num_object_copies":5556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1852,"num_write_kb":118528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.432398+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:35.432398+0000","last_peered":"2024-09-22T03:04:35.432398+0000","last_clean":"2024-09-22T03:04:35.432398+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:35.432398+0000","last_undegraded":"2024-09-22T03:04:35.432398+0000","last_fullsized":"2024-09-22T03:04:35.432398+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.137340+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:16.137340+0000","last_peered":"2024-09-22T03:04:16.137340+0000","last_clean":"2024-09-22T03:04:16.137340+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:16.137340+0000","last_undegraded":"2024-09-22T03:04:16.137340+0000","last_fullsized":"2024-09-22T03:04:16.137340+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"22'1889","reported_seq":1917,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.325902+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:04:36.325902+0000","last_peered":"2024-09-22T03:04:36.325902+0000","last_clean":"2024-09-22T03:04:36.325902+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:04:36.325902+0000","last_undegraded":"2024-09-22T03:04:36.325902+0000","last_fullsized":"2024-09-22T03:04:36.325902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1889,"log_dups_size":0,"ondisk_log_size":1889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123863040,"num_objects":1890,"num_object_clones":0,"num_object_copies":5670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1890,"num_write_kb":120960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1753","reported_seq":1781,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.298316+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:04:36.298316+0000","last_peered":"2024-09-22T03:04:36.298316+0000","last_clean":"2024-09-22T03:04:36.298316+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:04:36.298316+0000","last_undegraded":"2024-09-22T03:04:36.298316+0000","last_fullsized":"2024-09-22T03:04:36.298316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1753,"log_dups_size":0,"ondisk_log_size":1753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114950144,"num_objects":1754,"num_object_clones":0,"num_object_copies":5262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1754,"num_write_kb":112256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.420878+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:35.420878+0000","last_peered":"2024-09-22T03:04:35.420878+0000","last_clean":"2024-09-22T03:04:35.420878+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:35.420878+0000","last_undegraded":"2024-09-22T03:04:35.420878+0000","last_fullsized":"2024-09-22T03:04:35.420878+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'1850","reported_seq":1878,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.187126+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:04:36.187126+0000","last_peered":"2024-09-22T03:04:36.187126+0000","last_clean":"2024-09-22T03:04:36.187126+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:04:36.187126+0000","last_undegraded":"2024-09-22T03:04:36.187126+0000","last_fullsized":"2024-09-22T03:04:36.187126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1850,"log_dups_size":0,"ondisk_log_size":1850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121307136,"num_objects":1851,"num_object_clones":0,"num_object_copies":5553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1851,"num_write_kb":118464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.424386+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:35.424386+0000","last_peered":"2024-09-22T03:04:35.424386+0000","last_clean":"2024-09-22T03:04:35.424386+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:35.424386+0000","last_undegraded":"2024-09-22T03:04:35.424386+0000","last_fullsized":"2024-09-22T03:04:35.424386+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"22'1793","reported_seq":1821,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.214238+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:04:36.214238+0000","last_peered":"2024-09-22T03:04:36.214238+0000","last_clean":"2024-09-22T03:04:36.214238+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:04:36.214238+0000","last_undegraded":"2024-09-22T03:04:36.214238+0000","last_fullsized":"2024-09-22T03:04:36.214238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":0,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117571584,"num_objects":1794,"num_object_clones":0,"num_object_copies":5382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1794,"num_write_kb":114816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.420915+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:35.420915+0000","last_peered":"2024-09-22T03:04:35.420915+0000","last_clean":"2024-09-22T03:04:35.420915+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:35.420915+0000","last_undegraded":"2024-09-22T03:04:35.420915+0000","last_fullsized":"2024-09-22T03:04:35.420915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'1838","reported_seq":1866,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.213353+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:04:36.213353+0000","last_peered":"2024-09-22T03:04:36.213353+0000","last_clean":"2024-09-22T03:04:36.213353+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:04:36.213353+0000","last_undegraded":"2024-09-22T03:04:36.213353+0000","last_fullsized":"2024-09-22T03:04:36.213353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1838,"log_dups_size":0,"ondisk_log_size":1838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120520704,"num_objects":1839,"num_object_clones":0,"num_object_copies":5517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1839,"num_write_kb":117696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.421375+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:35.421375+0000","last_peered":"2024-09-22T03:04:35.421375+0000","last_clean":"2024-09-22T03:04:35.421375+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:35.421375+0000","last_undegraded":"2024-09-22T03:04:35.421375+0000","last_fullsized":"2024-09-22T03:04:35.421375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1899560960,"num_objects":28985,"num_object_clones":0,"num_object_copies":86955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28985,"num_write_kb":1855040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":356306944,"data_stored":5700911104,"data_compressed":270706432,"data_compressed_allocated":356306944,"data_compressed_original":5700911104,"omap_allocated":0,"internal_metadata":0},"log_size":28969,"ondisk_log_size":28969,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154208,"kb_used_data":101008,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94217632,"statfs":{"total":96636764160,"available":96478855168,"internally_reserved":0,"allocated":103432192,"data_stored":1651958384,"data_compressed":78440108,"data_compressed_allocated":103243776,"data_compressed_original":1651900416,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132484,"kb_used_data":79276,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94239356,"statfs":{"total":96636764160,"available":96501100544,"internally_reserved":0,"allocated":81178624,"data_stored":1295636423,"data_compressed":61522328,"data_compressed_allocated":80977920,"data_compressed_original":1295564800,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":144736,"kb_used_data":87376,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94227104,"statfs":{"total":96636764160,"available":96488554496,"internally_reserved":0,"allocated":89473024,"data_stored":1428219024,"data_compressed":67817812,"data_compressed_allocated":89264128,"data_compressed_original":1428144128,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126864,"kb_used_data":77824,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94244976,"statfs":{"total":96636764160,"available":96506855424,"internally_reserved":0,"allocated":79691776,"data_stored":1271912372,"data_compressed":60395766,"data_compressed_allocated":79495168,"data_compressed_original":1271840768,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":80293888,"data_stored":1284702208,"data_compressed":61003764,"data_compressed_allocated":80293888,"data_compressed_original":1284702208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90042368,"data_stored":1440677888,"data_compressed":68410250,"data_compressed_allocated":90042368,"data_compressed_original":1440677888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81735680,"data_stored":1307770880,"data_compressed":62099206,"data_compressed_allocated":81735680,"data_compressed_original":1307770880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":104235008,"data_stored":1667760128,"data_compressed":79193212,"data_compressed_allocated":104235008,"data_compressed_original":1667760128,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:38.912 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:39.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:39.049+0000 7fccd7d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:39.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:39.058+0000 7fccd7d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:39.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:39.098+0000 7f3948797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:39.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:39.109+0000 7f3947535640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:39.463 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:04:39.463 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:04:39.481 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 79 16 30054 30038 23.7613 17.5625 0.0702364 0.0420599 2024-09-22T03:04:39.486 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-22T03:04:39.322714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1900151347,"num_objects":28989,"num_object_clones":0,"num_object_copies":86967,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":29124,"num_write_kb":1856936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29069,"ondisk_log_size":29069,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":558292,"kb_used_data":345484,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":376929068,"statfs":{"total":386547056640,"available":385975365632,"internally_reserved":0,"allocated":353775616,"data_stored":5647726203,"data_compressed":268176014,"data_compressed_allocated":352980992,"data_compressed_original":5647450112,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":77332480,"num_objects":1180,"num_object_clones":0,"num_object_copies":3540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1180,"num_write_kb":75520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000722"},"pg_stats":[{"pgid":"3.f","version":"21'1795","reported_seq":1820,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.213583+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:04:34.213583+0000","last_peered":"2024-09-22T03:04:34.213583+0000","last_clean":"2024-09-22T03:04:34.213583+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:04:34.213583+0000","last_undegraded":"2024-09-22T03:04:34.213583+0000","last_fullsized":"2024-09-22T03:04:34.213583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1795,"log_dups_size":0,"ondisk_log_size":1795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117702656,"num_objects":1796,"num_object_clones":0,"num_object_copies":5388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1796,"num_write_kb":114944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"22'1859","reported_seq":1887,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.307715+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:04:36.307715+0000","last_peered":"2024-09-22T03:04:36.307715+0000","last_clean":"2024-09-22T03:04:36.307715+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:04:36.307715+0000","last_undegraded":"2024-09-22T03:04:36.307715+0000","last_fullsized":"2024-09-22T03:04:36.307715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1859,"log_dups_size":0,"ondisk_log_size":1859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121896960,"num_objects":1860,"num_object_clones":0,"num_object_copies":5580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1860,"num_write_kb":119040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1780","reported_seq":1808,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.310184+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:04:36.310184+0000","last_peered":"2024-09-22T03:04:36.310184+0000","last_clean":"2024-09-22T03:04:36.310184+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:04:36.310184+0000","last_undegraded":"2024-09-22T03:04:36.310184+0000","last_fullsized":"2024-09-22T03:04:36.310184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1780,"log_dups_size":0,"ondisk_log_size":1780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116719616,"num_objects":1781,"num_object_clones":0,"num_object_copies":5343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1781,"num_write_kb":113984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'1780","reported_seq":1805,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.241860+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:04:34.241860+0000","last_peered":"2024-09-22T03:04:34.241860+0000","last_clean":"2024-09-22T03:04:34.241860+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:04:34.241860+0000","last_undegraded":"2024-09-22T03:04:34.241860+0000","last_fullsized":"2024-09-22T03:04:34.241860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1780,"log_dups_size":0,"ondisk_log_size":1780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116719616,"num_objects":1781,"num_object_clones":0,"num_object_copies":5343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1781,"num_write_kb":113984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'1805","reported_seq":1833,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.232334+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:04:36.232334+0000","last_peered":"2024-09-22T03:04:36.232334+0000","last_clean":"2024-09-22T03:04:36.232334+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:04:36.232334+0000","last_undegraded":"2024-09-22T03:04:36.232334+0000","last_fullsized":"2024-09-22T03:04:36.232334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1805,"log_dups_size":0,"ondisk_log_size":1805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118358016,"num_objects":1806,"num_object_clones":0,"num_object_copies":5418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1806,"num_write_kb":115584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'1787","reported_seq":1812,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.172453+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:04:34.172453+0000","last_peered":"2024-09-22T03:04:34.172453+0000","last_clean":"2024-09-22T03:04:34.172453+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:04:34.172453+0000","last_undegraded":"2024-09-22T03:04:34.172453+0000","last_fullsized":"2024-09-22T03:04:34.172453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1787,"log_dups_size":0,"ondisk_log_size":1787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117178368,"num_objects":1788,"num_object_clones":0,"num_object_copies":5364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1788,"num_write_kb":114432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'1833","reported_seq":1858,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.285726+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:04:34.285726+0000","last_peered":"2024-09-22T03:04:34.285726+0000","last_clean":"2024-09-22T03:04:34.285726+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:04:34.285726+0000","last_undegraded":"2024-09-22T03:04:34.285726+0000","last_fullsized":"2024-09-22T03:04:34.285726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1833,"log_dups_size":0,"ondisk_log_size":1833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120193024,"num_objects":1834,"num_object_clones":0,"num_object_copies":5502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1834,"num_write_kb":117376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"22'1789","reported_seq":1817,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.276185+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:04:36.276185+0000","last_peered":"2024-09-22T03:04:36.276185+0000","last_clean":"2024-09-22T03:04:36.276185+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:04:36.276185+0000","last_undegraded":"2024-09-22T03:04:36.276185+0000","last_fullsized":"2024-09-22T03:04:36.276185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117309440,"num_objects":1790,"num_object_clones":0,"num_object_copies":5370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1790,"num_write_kb":114560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.420351+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:35.420351+0000","last_peered":"2024-09-22T03:04:35.420351+0000","last_clean":"2024-09-22T03:04:35.420351+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:35.420351+0000","last_undegraded":"2024-09-22T03:04:35.420351+0000","last_fullsized":"2024-09-22T03:04:35.420351+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"22'1832","reported_seq":1860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.273716+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:04:36.273716+0000","last_peered":"2024-09-22T03:04:36.273716+0000","last_clean":"2024-09-22T03:04:36.273716+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:04:36.273716+0000","last_undegraded":"2024-09-22T03:04:36.273716+0000","last_fullsized":"2024-09-22T03:04:36.273716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1832,"log_dups_size":0,"ondisk_log_size":1832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120127488,"num_objects":1833,"num_object_clones":0,"num_object_copies":5499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":117312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.139836+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:16.139836+0000","last_peered":"2024-09-22T03:04:16.139836+0000","last_clean":"2024-09-22T03:04:16.139836+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:16.139836+0000","last_undegraded":"2024-09-22T03:04:16.139836+0000","last_fullsized":"2024-09-22T03:04:16.139836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"22'1735","reported_seq":1763,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.148210+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:04:36.148210+0000","last_peered":"2024-09-22T03:04:36.148210+0000","last_clean":"2024-09-22T03:04:36.148210+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:04:36.148210+0000","last_undegraded":"2024-09-22T03:04:36.148210+0000","last_fullsized":"2024-09-22T03:04:36.148210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":0,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113770496,"num_objects":1736,"num_object_clones":0,"num_object_copies":5208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1736,"num_write_kb":111104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.421112+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:35.421112+0000","last_peered":"2024-09-22T03:04:35.421112+0000","last_clean":"2024-09-22T03:04:35.421112+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:35.421112+0000","last_undegraded":"2024-09-22T03:04:35.421112+0000","last_fullsized":"2024-09-22T03:04:35.421112+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'1851","reported_seq":1879,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.277468+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:04:36.277468+0000","last_peered":"2024-09-22T03:04:36.277468+0000","last_clean":"2024-09-22T03:04:36.277468+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:04:36.277468+0000","last_undegraded":"2024-09-22T03:04:36.277468+0000","last_fullsized":"2024-09-22T03:04:36.277468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1851,"log_dups_size":0,"ondisk_log_size":1851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121372672,"num_objects":1852,"num_object_clones":0,"num_object_copies":5556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1852,"num_write_kb":118528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.432398+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:35.432398+0000","last_peered":"2024-09-22T03:04:35.432398+0000","last_clean":"2024-09-22T03:04:35.432398+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:35.432398+0000","last_undegraded":"2024-09-22T03:04:35.432398+0000","last_fullsized":"2024-09-22T03:04:35.432398+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.137340+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:16.137340+0000","last_peered":"2024-09-22T03:04:16.137340+0000","last_clean":"2024-09-22T03:04:16.137340+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:16.137340+0000","last_undegraded":"2024-09-22T03:04:16.137340+0000","last_fullsized":"2024-09-22T03:04:16.137340+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"22'1889","reported_seq":1917,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.325902+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:04:36.325902+0000","last_peered":"2024-09-22T03:04:36.325902+0000","last_clean":"2024-09-22T03:04:36.325902+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:04:36.325902+0000","last_undegraded":"2024-09-22T03:04:36.325902+0000","last_fullsized":"2024-09-22T03:04:36.325902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1889,"log_dups_size":0,"ondisk_log_size":1889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123863040,"num_objects":1890,"num_object_clones":0,"num_object_copies":5670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1890,"num_write_kb":120960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1753","reported_seq":1781,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.298316+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:04:36.298316+0000","last_peered":"2024-09-22T03:04:36.298316+0000","last_clean":"2024-09-22T03:04:36.298316+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:04:36.298316+0000","last_undegraded":"2024-09-22T03:04:36.298316+0000","last_fullsized":"2024-09-22T03:04:36.298316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1753,"log_dups_size":0,"ondisk_log_size":1753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114950144,"num_objects":1754,"num_object_clones":0,"num_object_copies":5262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1754,"num_write_kb":112256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.420878+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:35.420878+0000","last_peered":"2024-09-22T03:04:35.420878+0000","last_clean":"2024-09-22T03:04:35.420878+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:35.420878+0000","last_undegraded":"2024-09-22T03:04:35.420878+0000","last_fullsized":"2024-09-22T03:04:35.420878+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'1850","reported_seq":1878,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.187126+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:04:36.187126+0000","last_peered":"2024-09-22T03:04:36.187126+0000","last_clean":"2024-09-22T03:04:36.187126+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:04:36.187126+0000","last_undegraded":"2024-09-22T03:04:36.187126+0000","last_fullsized":"2024-09-22T03:04:36.187126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1850,"log_dups_size":0,"ondisk_log_size":1850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121307136,"num_objects":1851,"num_object_clones":0,"num_object_copies":5553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1851,"num_write_kb":118464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.424386+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:35.424386+0000","last_peered":"2024-09-22T03:04:35.424386+0000","last_clean":"2024-09-22T03:04:35.424386+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:35.424386+0000","last_undegraded":"2024-09-22T03:04:35.424386+0000","last_fullsized":"2024-09-22T03:04:35.424386+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"22'1793","reported_seq":1821,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.214238+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:04:36.214238+0000","last_peered":"2024-09-22T03:04:36.214238+0000","last_clean":"2024-09-22T03:04:36.214238+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:04:36.214238+0000","last_undegraded":"2024-09-22T03:04:36.214238+0000","last_fullsized":"2024-09-22T03:04:36.214238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":0,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117571584,"num_objects":1794,"num_object_clones":0,"num_object_copies":5382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1794,"num_write_kb":114816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.420915+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:35.420915+0000","last_peered":"2024-09-22T03:04:35.420915+0000","last_clean":"2024-09-22T03:04:35.420915+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:35.420915+0000","last_undegraded":"2024-09-22T03:04:35.420915+0000","last_fullsized":"2024-09-22T03:04:35.420915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'1838","reported_seq":1866,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.213353+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:04:36.213353+0000","last_peered":"2024-09-22T03:04:36.213353+0000","last_clean":"2024-09-22T03:04:36.213353+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:04:36.213353+0000","last_undegraded":"2024-09-22T03:04:36.213353+0000","last_fullsized":"2024-09-22T03:04:36.213353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1838,"log_dups_size":0,"ondisk_log_size":1838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120520704,"num_objects":1839,"num_object_clones":0,"num_object_copies":5517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1839,"num_write_kb":117696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.421375+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:35.421375+0000","last_peered":"2024-09-22T03:04:35.421375+0000","last_clean":"2024-09-22T03:04:35.421375+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:35.421375+0000","last_undegraded":"2024-09-22T03:04:35.421375+0000","last_fullsized":"2024-09-22T03:04:35.421375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1899560960,"num_objects":28985,"num_object_clones":0,"num_object_copies":86955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28985,"num_write_kb":1855040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":356306944,"data_stored":5700911104,"data_compressed":270706432,"data_compressed_allocated":356306944,"data_compressed_original":5700911104,"omap_allocated":0,"internal_metadata":0},"log_size":28969,"ondisk_log_size":28969,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154208,"kb_used_data":101008,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94217632,"statfs":{"total":96636764160,"available":96478855168,"internally_reserved":0,"allocated":103432192,"data_stored":1651958384,"data_compressed":78440108,"data_compressed_allocated":103243776,"data_compressed_original":1651900416,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132484,"kb_used_data":79276,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94239356,"statfs":{"total":96636764160,"available":96501100544,"internally_reserved":0,"allocated":81178624,"data_stored":1295636423,"data_compressed":61522328,"data_compressed_allocated":80977920,"data_compressed_original":1295564800,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":144736,"kb_used_data":87376,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94227104,"statfs":{"total":96636764160,"available":96488554496,"internally_reserved":0,"allocated":89473024,"data_stored":1428219024,"data_compressed":67817812,"data_compressed_allocated":89264128,"data_compressed_original":1428144128,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126864,"kb_used_data":77824,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94244976,"statfs":{"total":96636764160,"available":96506855424,"internally_reserved":0,"allocated":79691776,"data_stored":1271912372,"data_compressed":60395766,"data_compressed_allocated":79495168,"data_compressed_original":1271840768,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":80293888,"data_stored":1284702208,"data_compressed":61003764,"data_compressed_allocated":80293888,"data_compressed_original":1284702208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90042368,"data_stored":1440677888,"data_compressed":68410250,"data_compressed_allocated":90042368,"data_compressed_original":1440677888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81735680,"data_stored":1307770880,"data_compressed":62099206,"data_compressed_allocated":81735680,"data_compressed_original":1307770880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":104235008,"data_stored":1667760128,"data_compressed":79193212,"data_compressed_allocated":104235008,"data_compressed_original":1667760128,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:39.487 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:04:39.487 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:39.487 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:39.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:39.632+0000 7f40554d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:39.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:39.644+0000 7f40554d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:39.902 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:04:39.903 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:04:39.926 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-09-22T03:04:39.322714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1900151347,"num_objects":28989,"num_object_clones":0,"num_object_copies":86967,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":29124,"num_write_kb":1856936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29069,"ondisk_log_size":29069,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":558292,"kb_used_data":345484,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":376929068,"statfs":{"total":386547056640,"available":385975365632,"internally_reserved":0,"allocated":353775616,"data_stored":5647726203,"data_compressed":268176014,"data_compressed_allocated":352980992,"data_compressed_original":5647450112,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":77332480,"num_objects":1180,"num_object_clones":0,"num_object_copies":3540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1180,"num_write_kb":75520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000722"},"pg_stats":[{"pgid":"3.f","version":"21'1795","reported_seq":1820,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.213583+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:04:34.213583+0000","last_peered":"2024-09-22T03:04:34.213583+0000","last_clean":"2024-09-22T03:04:34.213583+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:04:34.213583+0000","last_undegraded":"2024-09-22T03:04:34.213583+0000","last_fullsized":"2024-09-22T03:04:34.213583+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1795,"log_dups_size":0,"ondisk_log_size":1795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117702656,"num_objects":1796,"num_object_clones":0,"num_object_copies":5388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1796,"num_write_kb":114944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"22'1859","reported_seq":1887,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.307715+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:04:36.307715+0000","last_peered":"2024-09-22T03:04:36.307715+0000","last_clean":"2024-09-22T03:04:36.307715+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:04:36.307715+0000","last_undegraded":"2024-09-22T03:04:36.307715+0000","last_fullsized":"2024-09-22T03:04:36.307715+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1859,"log_dups_size":0,"ondisk_log_size":1859,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121896960,"num_objects":1860,"num_object_clones":0,"num_object_copies":5580,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1860,"num_write_kb":119040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1780","reported_seq":1808,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.310184+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:04:36.310184+0000","last_peered":"2024-09-22T03:04:36.310184+0000","last_clean":"2024-09-22T03:04:36.310184+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:04:36.310184+0000","last_undegraded":"2024-09-22T03:04:36.310184+0000","last_fullsized":"2024-09-22T03:04:36.310184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1780,"log_dups_size":0,"ondisk_log_size":1780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116719616,"num_objects":1781,"num_object_clones":0,"num_object_copies":5343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1781,"num_write_kb":113984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"21'1780","reported_seq":1805,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.241860+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:04:34.241860+0000","last_peered":"2024-09-22T03:04:34.241860+0000","last_clean":"2024-09-22T03:04:34.241860+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:04:34.241860+0000","last_undegraded":"2024-09-22T03:04:34.241860+0000","last_fullsized":"2024-09-22T03:04:34.241860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1780,"log_dups_size":0,"ondisk_log_size":1780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116719616,"num_objects":1781,"num_object_clones":0,"num_object_copies":5343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1781,"num_write_kb":113984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'1805","reported_seq":1833,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.232334+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:04:36.232334+0000","last_peered":"2024-09-22T03:04:36.232334+0000","last_clean":"2024-09-22T03:04:36.232334+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:04:36.232334+0000","last_undegraded":"2024-09-22T03:04:36.232334+0000","last_fullsized":"2024-09-22T03:04:36.232334+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1805,"log_dups_size":0,"ondisk_log_size":1805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118358016,"num_objects":1806,"num_object_clones":0,"num_object_copies":5418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1806,"num_write_kb":115584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"21'1787","reported_seq":1812,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.172453+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:04:34.172453+0000","last_peered":"2024-09-22T03:04:34.172453+0000","last_clean":"2024-09-22T03:04:34.172453+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:04:34.172453+0000","last_undegraded":"2024-09-22T03:04:34.172453+0000","last_fullsized":"2024-09-22T03:04:34.172453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1787,"log_dups_size":0,"ondisk_log_size":1787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117178368,"num_objects":1788,"num_object_clones":0,"num_object_copies":5364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1788,"num_write_kb":114432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"21'1833","reported_seq":1858,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:34.285726+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:04:34.285726+0000","last_peered":"2024-09-22T03:04:34.285726+0000","last_clean":"2024-09-22T03:04:34.285726+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:04:34.285726+0000","last_undegraded":"2024-09-22T03:04:34.285726+0000","last_fullsized":"2024-09-22T03:04:34.285726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1833,"log_dups_size":0,"ondisk_log_size":1833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120193024,"num_objects":1834,"num_object_clones":0,"num_object_copies":5502,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1834,"num_write_kb":117376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"22'1789","reported_seq":1817,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.276185+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:04:36.276185+0000","last_peered":"2024-09-22T03:04:36.276185+0000","last_clean":"2024-09-22T03:04:36.276185+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:04:36.276185+0000","last_undegraded":"2024-09-22T03:04:36.276185+0000","last_fullsized":"2024-09-22T03:04:36.276185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1789,"log_dups_size":0,"ondisk_log_size":1789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117309440,"num_objects":1790,"num_object_clones":0,"num_object_copies":5370,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1790,"num_write_kb":114560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.420351+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:35.420351+0000","last_peered":"2024-09-22T03:04:35.420351+0000","last_clean":"2024-09-22T03:04:35.420351+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:35.420351+0000","last_undegraded":"2024-09-22T03:04:35.420351+0000","last_fullsized":"2024-09-22T03:04:35.420351+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"22'1832","reported_seq":1860,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.273716+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:04:36.273716+0000","last_peered":"2024-09-22T03:04:36.273716+0000","last_clean":"2024-09-22T03:04:36.273716+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:04:36.273716+0000","last_undegraded":"2024-09-22T03:04:36.273716+0000","last_fullsized":"2024-09-22T03:04:36.273716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1832,"log_dups_size":0,"ondisk_log_size":1832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120127488,"num_objects":1833,"num_object_clones":0,"num_object_copies":5499,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1833,"num_write_kb":117312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":37,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.139836+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:16.139836+0000","last_peered":"2024-09-22T03:04:16.139836+0000","last_clean":"2024-09-22T03:04:16.139836+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:16.139836+0000","last_undegraded":"2024-09-22T03:04:16.139836+0000","last_fullsized":"2024-09-22T03:04:16.139836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"22'1735","reported_seq":1763,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.148210+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:04:36.148210+0000","last_peered":"2024-09-22T03:04:36.148210+0000","last_clean":"2024-09-22T03:04:36.148210+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:04:36.148210+0000","last_undegraded":"2024-09-22T03:04:36.148210+0000","last_fullsized":"2024-09-22T03:04:36.148210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1735,"log_dups_size":0,"ondisk_log_size":1735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113770496,"num_objects":1736,"num_object_clones":0,"num_object_copies":5208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1736,"num_write_kb":111104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":42,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.421112+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:35.421112+0000","last_peered":"2024-09-22T03:04:35.421112+0000","last_clean":"2024-09-22T03:04:35.421112+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:35.421112+0000","last_undegraded":"2024-09-22T03:04:35.421112+0000","last_fullsized":"2024-09-22T03:04:35.421112+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'1851","reported_seq":1879,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.277468+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:04:36.277468+0000","last_peered":"2024-09-22T03:04:36.277468+0000","last_clean":"2024-09-22T03:04:36.277468+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:04:36.277468+0000","last_undegraded":"2024-09-22T03:04:36.277468+0000","last_fullsized":"2024-09-22T03:04:36.277468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1851,"log_dups_size":0,"ondisk_log_size":1851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121372672,"num_objects":1852,"num_object_clones":0,"num_object_copies":5556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1852,"num_write_kb":118528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":41,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.432398+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:35.432398+0000","last_peered":"2024-09-22T03:04:35.432398+0000","last_clean":"2024-09-22T03:04:35.432398+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:35.432398+0000","last_undegraded":"2024-09-22T03:04:35.432398+0000","last_fullsized":"2024-09-22T03:04:35.432398+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":163,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-22T03:04:16.137340+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:16.137340+0000","last_peered":"2024-09-22T03:04:16.137340+0000","last_clean":"2024-09-22T03:04:16.137340+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:16.137340+0000","last_undegraded":"2024-09-22T03:04:16.137340+0000","last_fullsized":"2024-09-22T03:04:16.137340+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"22'1889","reported_seq":1917,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.325902+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:04:36.325902+0000","last_peered":"2024-09-22T03:04:36.325902+0000","last_clean":"2024-09-22T03:04:36.325902+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:04:36.325902+0000","last_undegraded":"2024-09-22T03:04:36.325902+0000","last_fullsized":"2024-09-22T03:04:36.325902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1889,"log_dups_size":0,"ondisk_log_size":1889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123863040,"num_objects":1890,"num_object_clones":0,"num_object_copies":5670,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1890,"num_write_kb":120960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1753","reported_seq":1781,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.298316+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:04:36.298316+0000","last_peered":"2024-09-22T03:04:36.298316+0000","last_clean":"2024-09-22T03:04:36.298316+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:04:36.298316+0000","last_undegraded":"2024-09-22T03:04:36.298316+0000","last_fullsized":"2024-09-22T03:04:36.298316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1753,"log_dups_size":0,"ondisk_log_size":1753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114950144,"num_objects":1754,"num_object_clones":0,"num_object_copies":5262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1754,"num_write_kb":112256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.420878+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:35.420878+0000","last_peered":"2024-09-22T03:04:35.420878+0000","last_clean":"2024-09-22T03:04:35.420878+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:35.420878+0000","last_undegraded":"2024-09-22T03:04:35.420878+0000","last_fullsized":"2024-09-22T03:04:35.420878+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'1850","reported_seq":1878,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.187126+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:04:36.187126+0000","last_peered":"2024-09-22T03:04:36.187126+0000","last_clean":"2024-09-22T03:04:36.187126+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:04:36.187126+0000","last_undegraded":"2024-09-22T03:04:36.187126+0000","last_fullsized":"2024-09-22T03:04:36.187126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1850,"log_dups_size":0,"ondisk_log_size":1850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121307136,"num_objects":1851,"num_object_clones":0,"num_object_copies":5553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1851,"num_write_kb":118464,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.424386+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:35.424386+0000","last_peered":"2024-09-22T03:04:35.424386+0000","last_clean":"2024-09-22T03:04:35.424386+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:35.424386+0000","last_undegraded":"2024-09-22T03:04:35.424386+0000","last_fullsized":"2024-09-22T03:04:35.424386+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"22'1793","reported_seq":1821,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.214238+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:04:36.214238+0000","last_peered":"2024-09-22T03:04:36.214238+0000","last_clean":"2024-09-22T03:04:36.214238+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:04:36.214238+0000","last_undegraded":"2024-09-22T03:04:36.214238+0000","last_fullsized":"2024-09-22T03:04:36.214238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1793,"log_dups_size":0,"ondisk_log_size":1793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117571584,"num_objects":1794,"num_object_clones":0,"num_object_copies":5382,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1794,"num_write_kb":114816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.420915+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:35.420915+0000","last_peered":"2024-09-22T03:04:35.420915+0000","last_clean":"2024-09-22T03:04:35.420915+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:35.420915+0000","last_undegraded":"2024-09-22T03:04:35.420915+0000","last_fullsized":"2024-09-22T03:04:35.420915+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'1838","reported_seq":1866,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:36.213353+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:04:36.213353+0000","last_peered":"2024-09-22T03:04:36.213353+0000","last_clean":"2024-09-22T03:04:36.213353+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:04:36.213353+0000","last_undegraded":"2024-09-22T03:04:36.213353+0000","last_fullsized":"2024-09-22T03:04:36.213353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1838,"log_dups_size":0,"ondisk_log_size":1838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120520704,"num_objects":1839,"num_object_clones":0,"num_object_copies":5517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1839,"num_write_kb":117696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-22T03:04:35.421375+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:35.421375+0000","last_peered":"2024-09-22T03:04:35.421375+0000","last_clean":"2024-09-22T03:04:35.421375+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:35.421375+0000","last_undegraded":"2024-09-22T03:04:35.421375+0000","last_fullsized":"2024-09-22T03:04:35.421375+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1899560960,"num_objects":28985,"num_object_clones":0,"num_object_copies":86955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28985,"num_write_kb":1855040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":356306944,"data_stored":5700911104,"data_compressed":270706432,"data_compressed_allocated":356306944,"data_compressed_original":5700911104,"omap_allocated":0,"internal_metadata":0},"log_size":28969,"ondisk_log_size":28969,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154208,"kb_used_data":101008,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94217632,"statfs":{"total":96636764160,"available":96478855168,"internally_reserved":0,"allocated":103432192,"data_stored":1651958384,"data_compressed":78440108,"data_compressed_allocated":103243776,"data_compressed_original":1651900416,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132484,"kb_used_data":79276,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94239356,"statfs":{"total":96636764160,"available":96501100544,"internally_reserved":0,"allocated":81178624,"data_stored":1295636423,"data_compressed":61522328,"data_compressed_allocated":80977920,"data_compressed_original":1295564800,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673050,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":144736,"kb_used_data":87376,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94227104,"statfs":{"total":96636764160,"available":96488554496,"internally_reserved":0,"allocated":89473024,"data_stored":1428219024,"data_compressed":67817812,"data_compressed_allocated":89264128,"data_compressed_original":1428144128,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":126864,"kb_used_data":77824,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94244976,"statfs":{"total":96636764160,"available":96506855424,"internally_reserved":0,"allocated":79691776,"data_stored":1271912372,"data_compressed":60395766,"data_compressed_allocated":79495168,"data_compressed_original":1271840768,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":80293888,"data_stored":1284702208,"data_compressed":61003764,"data_compressed_allocated":80293888,"data_compressed_original":1284702208,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90042368,"data_stored":1440677888,"data_compressed":68410250,"data_compressed_allocated":90042368,"data_compressed_original":1440677888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81735680,"data_stored":1307770880,"data_compressed":62099206,"data_compressed_allocated":81735680,"data_compressed_original":1307770880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":104235008,"data_stored":1667760128,"data_compressed":79193212,"data_compressed_allocated":104235008,"data_compressed_original":1667760128,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:40.482 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:2024-09-22T03:04:40.481274+0000 min lat: 0.009172 max lat: 0.177948 avg lat: 0.0421929 2024-09-22T03:04:40.482 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:04:40.482 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 80 16 30341 30325 23.6885 17.9375 0.0551407 0.0421929 2024-09-22T03:04:41.341 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:41.482 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 81 16 30658 30642 23.6406 19.8125 0.0305645 0.0422747 2024-09-22T03:04:41.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:41.495+0000 7f3f8906c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:41.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:41.505+0000 7f3f8906c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:42.482 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 82 16 30963 30947 23.5848 19.0625 0.0520484 0.0423812 2024-09-22T03:04:43.482 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 83 16 31267 31251 23.5295 19 0.0452628 0.042475 2024-09-22T03:04:43.791 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:43.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:43.942+0000 7f8ff46d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:43.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:43.951+0000 7f8ff46d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:44.482 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 84 16 31561 31545 23.4681 18.375 0.0823101 0.0425869 2024-09-22T03:04:44.928 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:44.929 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:44.929 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:04:44.929 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:04:45.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:45.081+0000 7f4cb8c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:45.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:45.094+0000 7f4cb8c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:45.139 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:45.139 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:04:45.139 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:04:45.139 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:04:45.139 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:04:45.139 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:04:45.140 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:04:45.140 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:04:45.140 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:04:45.140 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:04:45.140 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:04:45.140 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:04:45.143 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:45.144 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:45.144 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:04:45.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:45.290+0000 7f7f2e757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:45.496 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:45.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:45.304+0000 7f7f2e757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:45.497 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:45.497 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:04:45.497 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:04:45.497 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:04:45.497 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:04:45.497 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:04:45.497 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:04:45.497 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:04:45.497 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:04:45.497 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:04:45.497 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:04:45.498 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:04:45.498 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:45.498 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:04:45.499 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 85 16 31866 31850 23.4163 19.0625 0.0613875 0.042689 2024-09-22T03:04:45.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:45.647+0000 7f2760597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:45.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:45.659+0000 7f2760597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:45.695 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:45.695 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:04:45.695 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:04:45.695 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:04:45.695 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:04:45.695 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:04:45.696 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:04:45.696 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:04:45.696 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:04:45.696 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:04:45.696 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:04:45.696 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:04:45.699 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:45.700 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:45.700 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:04:45.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:45.848+0000 7f6ee7d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:45.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:45.860+0000 7f6ee7d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:45.902 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:04:45.902 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:04:45.902 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:04:45.902 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:04:45.902 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:04:45.902 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:04:45.902 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:04:45.902 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:04:45.902 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:04:45.902 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:04:45.903 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:04:45.903 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:04:45.906 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:04:45.906 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:04:46.287 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:46.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:46.430+0000 7f8c092b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:46.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:46.436+0000 7f8c092b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:46.482 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 86 16 32171 32155 23.3656 19.0625 0.0756691 0.0427762 2024-09-22T03:04:47.482 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 87 16 32475 32459 23.3154 19 0.0319663 0.0428725 2024-09-22T03:04:48.482 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 88 16 32787 32771 23.2721 19.5 0.0648065 0.0429498 2024-09-22T03:04:48.749 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:48.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:48.897+0000 7f6198757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:48.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:48.904+0000 7f6198757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:49.482 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 89 16 33090 33074 23.2233 18.9375 0.0541402 0.0430357 2024-09-22T03:04:50.483 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 90 16 33404 33388 23.1833 19.625 0.0414867 0.043115 2024-09-22T03:04:50.907 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:50.907 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:50.907 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:51.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:51.055+0000 7fcab56a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:51.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:51.064+0000 7fcab56a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:51.279 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:51.371 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:04:51.372 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:04:51.394 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-09-22T03:04:51.324908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2121466419,"num_objects":32366,"num_object_clones":0,"num_object_copies":97098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":32501,"num_write_kb":2073064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32446,"ondisk_log_size":32446,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":569384,"kb_used_data":385700,"kb_used_omap":0,"kb_used_meta":183616,"kb_avail":376917976,"statfs":{"total":386547056640,"available":385964007424,"internally_reserved":0,"allocated":394956800,"data_stored":6304835961,"data_compressed":299376926,"data_compressed_allocated":394047488,"data_compressed_original":6304514048,"omap_allocated":0,"internal_metadata":188022784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":221315072,"num_objects":3377,"num_object_clones":0,"num_object_copies":10131,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3377,"num_write_kb":216128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002194"},"pg_stats":[{"pgid":"3.f","version":"25'2079","reported_seq":2116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:49.245112+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:04:49.245112+0000","last_peered":"2024-09-22T03:04:49.245112+0000","last_clean":"2024-09-22T03:04:49.245112+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:04:49.245112+0000","last_undegraded":"2024-09-22T03:04:49.245112+0000","last_fullsized":"2024-09-22T03:04:49.245112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2079,"log_dups_size":0,"ondisk_log_size":2079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136314880,"num_objects":2080,"num_object_clones":0,"num_object_copies":6240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2080,"num_write_kb":133120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'2043","reported_seq":2080,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.209703+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:04:46.209703+0000","last_peered":"2024-09-22T03:04:46.209703+0000","last_clean":"2024-09-22T03:04:46.209703+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:04:46.209703+0000","last_undegraded":"2024-09-22T03:04:46.209703+0000","last_fullsized":"2024-09-22T03:04:46.209703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133955584,"num_objects":2044,"num_object_clones":0,"num_object_copies":6132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2044,"num_write_kb":130816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'1954","reported_seq":1991,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.200976+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:04:46.200976+0000","last_peered":"2024-09-22T03:04:46.200976+0000","last_clean":"2024-09-22T03:04:46.200976+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:04:46.200976+0000","last_undegraded":"2024-09-22T03:04:46.200976+0000","last_fullsized":"2024-09-22T03:04:46.200976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128122880,"num_objects":1955,"num_object_clones":0,"num_object_copies":5865,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1955,"num_write_kb":125120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'2067","reported_seq":2104,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:49.275629+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:04:49.275629+0000","last_peered":"2024-09-22T03:04:49.275629+0000","last_clean":"2024-09-22T03:04:49.275629+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:04:49.275629+0000","last_undegraded":"2024-09-22T03:04:49.275629+0000","last_fullsized":"2024-09-22T03:04:49.275629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2067,"log_dups_size":0,"ondisk_log_size":2067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135528448,"num_objects":2068,"num_object_clones":0,"num_object_copies":6204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2068,"num_write_kb":132352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'1993","reported_seq":2030,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.193773+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:04:46.193773+0000","last_peered":"2024-09-22T03:04:46.193773+0000","last_clean":"2024-09-22T03:04:46.193773+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:04:46.193773+0000","last_undegraded":"2024-09-22T03:04:46.193773+0000","last_fullsized":"2024-09-22T03:04:46.193773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1993,"log_dups_size":0,"ondisk_log_size":1993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130678784,"num_objects":1994,"num_object_clones":0,"num_object_copies":5982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1994,"num_write_kb":127616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'2051","reported_seq":2088,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:49.315422+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:04:49.315422+0000","last_peered":"2024-09-22T03:04:49.315422+0000","last_clean":"2024-09-22T03:04:49.315422+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:04:49.315422+0000","last_undegraded":"2024-09-22T03:04:49.315422+0000","last_fullsized":"2024-09-22T03:04:49.315422+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134479872,"num_objects":2052,"num_object_clones":0,"num_object_copies":6156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2052,"num_write_kb":131328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'2134","reported_seq":2171,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:49.291725+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:04:49.291725+0000","last_peered":"2024-09-22T03:04:49.291725+0000","last_clean":"2024-09-22T03:04:49.291725+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:04:49.291725+0000","last_undegraded":"2024-09-22T03:04:49.291725+0000","last_fullsized":"2024-09-22T03:04:49.291725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2134,"log_dups_size":0,"ondisk_log_size":2134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139919360,"num_objects":2135,"num_object_clones":0,"num_object_copies":6405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2135,"num_write_kb":136640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'1979","reported_seq":2016,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.293900+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:04:46.293900+0000","last_peered":"2024-09-22T03:04:46.293900+0000","last_clean":"2024-09-22T03:04:46.293900+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:04:46.293900+0000","last_undegraded":"2024-09-22T03:04:46.293900+0000","last_fullsized":"2024-09-22T03:04:46.293900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129761280,"num_objects":1980,"num_object_clones":0,"num_object_copies":5940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1980,"num_write_kb":126720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'2027","reported_seq":2064,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.291755+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:04:46.291755+0000","last_peered":"2024-09-22T03:04:46.291755+0000","last_clean":"2024-09-22T03:04:46.291755+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:04:46.291755+0000","last_undegraded":"2024-09-22T03:04:46.291755+0000","last_fullsized":"2024-09-22T03:04:46.291755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2027,"log_dups_size":0,"ondisk_log_size":2027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132907008,"num_objects":2028,"num_object_clones":0,"num_object_copies":6084,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2028,"num_write_kb":129792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'1919","reported_seq":1956,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.300895+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:04:46.300895+0000","last_peered":"2024-09-22T03:04:46.300895+0000","last_clean":"2024-09-22T03:04:46.300895+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:04:46.300895+0000","last_undegraded":"2024-09-22T03:04:46.300895+0000","last_fullsized":"2024-09-22T03:04:46.300895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1919,"log_dups_size":0,"ondisk_log_size":1919,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":1920,"num_object_clones":0,"num_object_copies":5760,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1920,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'2031","reported_seq":2068,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.251167+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:04:46.251167+0000","last_peered":"2024-09-22T03:04:46.251167+0000","last_clean":"2024-09-22T03:04:46.251167+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:04:46.251167+0000","last_undegraded":"2024-09-22T03:04:46.251167+0000","last_fullsized":"2024-09-22T03:04:46.251167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133169152,"num_objects":2032,"num_object_clones":0,"num_object_copies":6096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2032,"num_write_kb":130048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'2071","reported_seq":2108,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.246268+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:04:46.246268+0000","last_peered":"2024-09-22T03:04:46.246268+0000","last_clean":"2024-09-22T03:04:46.246268+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:04:46.246268+0000","last_undegraded":"2024-09-22T03:04:46.246268+0000","last_fullsized":"2024-09-22T03:04:46.246268+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135790592,"num_objects":2072,"num_object_clones":0,"num_object_copies":6216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2072,"num_write_kb":132608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1946","reported_seq":1983,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.247674+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:04:46.247674+0000","last_peered":"2024-09-22T03:04:46.247674+0000","last_clean":"2024-09-22T03:04:46.247674+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:04:46.247674+0000","last_undegraded":"2024-09-22T03:04:46.247674+0000","last_fullsized":"2024-09-22T03:04:46.247674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1946,"log_dups_size":0,"ondisk_log_size":1946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":127598592,"num_objects":1947,"num_object_clones":0,"num_object_copies":5841,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1947,"num_write_kb":124608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'2043","reported_seq":2080,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.321207+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:04:46.321207+0000","last_peered":"2024-09-22T03:04:46.321207+0000","last_clean":"2024-09-22T03:04:46.321207+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:04:46.321207+0000","last_undegraded":"2024-09-22T03:04:46.321207+0000","last_fullsized":"2024-09-22T03:04:46.321207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133955584,"num_objects":2044,"num_object_clones":0,"num_object_copies":6132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2044,"num_write_kb":130816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'1980","reported_seq":2017,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.070908+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:04:46.070908+0000","last_peered":"2024-09-22T03:04:46.070908+0000","last_clean":"2024-09-22T03:04:46.070908+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:04:46.070908+0000","last_undegraded":"2024-09-22T03:04:46.070908+0000","last_fullsized":"2024-09-22T03:04:46.070908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129826816,"num_objects":1981,"num_object_clones":0,"num_object_copies":5943,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1981,"num_write_kb":126784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2029","reported_seq":2066,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:46.307293+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:04:46.307293+0000","last_peered":"2024-09-22T03:04:46.307293+0000","last_clean":"2024-09-22T03:04:46.307293+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:04:46.307293+0000","last_undegraded":"2024-09-22T03:04:46.307293+0000","last_fullsized":"2024-09-22T03:04:46.307293+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2029,"log_dups_size":0,"ondisk_log_size":2029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133038080,"num_objects":2030,"num_object_clones":0,"num_object_copies":6090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2030,"num_write_kb":129920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2120876032,"num_objects":32362,"num_object_clones":0,"num_object_copies":97086,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32362,"num_write_kb":2071168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":397361152,"data_stored":6357778432,"data_compressed":301898008,"data_compressed_allocated":397361152,"data_compressed_original":6357778432,"omap_allocated":0,"internal_metadata":0},"log_size":32346,"ondisk_log_size":32346,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673060,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":156376,"kb_used_data":111492,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94215464,"statfs":{"total":96636764160,"available":96476635136,"internally_reserved":0,"allocated":114167808,"data_stored":1823344843,"data_compressed":86577988,"data_compressed_allocated":113954816,"data_compressed_original":1823277056,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673060,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132312,"kb_used_data":87432,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94239528,"statfs":{"total":96636764160,"available":96501276672,"internally_reserved":0,"allocated":89530368,"data_stored":1428753131,"data_compressed":67842800,"data_compressed_allocated":89296896,"data_compressed_original":1428668416,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673060,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":145416,"kb_used_data":96376,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94226424,"statfs":{"total":96636764160,"available":96487858176,"internally_reserved":0,"allocated":98689024,"data_stored":1575291627,"data_compressed":74801140,"data_compressed_allocated":98455552,"data_compressed_original":1575206912,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":135280,"kb_used_data":90400,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94236560,"statfs":{"total":96636764160,"available":96498237440,"internally_reserved":0,"allocated":92569600,"data_stored":1477446360,"data_compressed":70154998,"data_compressed_allocated":92340224,"data_compressed_original":1477361664,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93052928,"data_stored":1488846848,"data_compressed":70697644,"data_compressed_allocated":93052928,"data_compressed_original":1488846848,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":99246080,"data_stored":1587937280,"data_compressed":75402914,"data_compressed_allocated":99246080,"data_compressed_original":1587937280,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90103808,"data_stored":1441660928,"data_compressed":68457022,"data_compressed_allocated":90103808,"data_compressed_original":1441660928,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":114958336,"data_stored":1839333376,"data_compressed":87340428,"data_compressed_allocated":114958336,"data_compressed_original":1839333376,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:51.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:51.434+0000 7f60e78ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:51.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:51.442+0000 7f60e78ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:51.482 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 91 16 33680 33664 23.1181 17.25 0.0381236 0.0432379 2024-09-22T03:04:52.483 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 92 16 33981 33965 23.0713 18.8125 0.0347107 0.0433265 2024-09-22T03:04:53.483 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 93 16 34290 34274 23.0309 19.3125 0.0466171 0.0434026 2024-09-22T03:04:53.732 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:53.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:53.874+0000 7f3d0c42c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:53.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:53.884+0000 7f3d0c42c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:54.483 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 94 16 34586 34570 22.9827 18.5 0.0685996 0.0434903 2024-09-22T03:04:55.483 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 95 16 34879 34863 22.9335 18.3125 0.0894035 0.0435828 2024-09-22T03:04:56.321 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:04:56.396 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:04:56.396 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:04:56.397 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:04:56.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:56.458+0000 7f12d4197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:56.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:56.464+0000 7f12d4197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:56.483 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 96 16 35170 35154 22.884 18.1875 0.0583868 0.0436823 2024-09-22T03:04:56.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:56.542+0000 7fd4a0cb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:56.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:56.556+0000 7fd4a0cb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:56.855 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:04:56.855 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:04:56.876 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-09-22T03:04:55.325690+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2219967027,"num_objects":33869,"num_object_clones":0,"num_object_copies":101607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":34004,"num_write_kb":2169256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33949,"ondisk_log_size":33949,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":604448,"kb_used_data":404128,"kb_used_omap":0,"kb_used_meta":200256,"kb_avail":376882912,"statfs":{"total":386547056640,"available":385928101888,"internally_reserved":0,"allocated":413827072,"data_stored":6606760313,"data_compressed":313713907,"data_compressed_allocated":412917760,"data_compressed_original":6606438400,"omap_allocated":0,"internal_metadata":205062144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":223019008,"num_objects":3403,"num_object_clones":0,"num_object_copies":10209,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3403,"num_write_kb":217792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002308"},"pg_stats":[{"pgid":"3.f","version":"25'2167","reported_seq":2204,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:54.168396+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:04:54.168396+0000","last_peered":"2024-09-22T03:04:54.168396+0000","last_clean":"2024-09-22T03:04:54.168396+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:04:54.168396+0000","last_undegraded":"2024-09-22T03:04:54.168396+0000","last_fullsized":"2024-09-22T03:04:54.168396+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2167,"log_dups_size":0,"ondisk_log_size":2167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142082048,"num_objects":2168,"num_object_clones":0,"num_object_copies":6504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2168,"num_write_kb":138752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'2146","reported_seq":2183,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.301905+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:04:51.301905+0000","last_peered":"2024-09-22T03:04:51.301905+0000","last_clean":"2024-09-22T03:04:51.301905+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:04:51.301905+0000","last_undegraded":"2024-09-22T03:04:51.301905+0000","last_fullsized":"2024-09-22T03:04:51.301905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2146,"log_dups_size":0,"ondisk_log_size":2146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140705792,"num_objects":2147,"num_object_clones":0,"num_object_copies":6441,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2147,"num_write_kb":137408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'2046","reported_seq":2083,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.295602+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:04:51.295602+0000","last_peered":"2024-09-22T03:04:51.295602+0000","last_clean":"2024-09-22T03:04:51.295602+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:04:51.295602+0000","last_undegraded":"2024-09-22T03:04:51.295602+0000","last_fullsized":"2024-09-22T03:04:51.295602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2046,"log_dups_size":0,"ondisk_log_size":2046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134152192,"num_objects":2047,"num_object_clones":0,"num_object_copies":6141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2047,"num_write_kb":131008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'2166","reported_seq":2203,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:54.184059+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:04:54.184059+0000","last_peered":"2024-09-22T03:04:54.184059+0000","last_clean":"2024-09-22T03:04:54.184059+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:04:54.184059+0000","last_undegraded":"2024-09-22T03:04:54.184059+0000","last_fullsized":"2024-09-22T03:04:54.184059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2166,"log_dups_size":0,"ondisk_log_size":2166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142016512,"num_objects":2167,"num_object_clones":0,"num_object_copies":6501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2167,"num_write_kb":138688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'2064","reported_seq":2101,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.140536+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:04:51.140536+0000","last_peered":"2024-09-22T03:04:51.140536+0000","last_clean":"2024-09-22T03:04:51.140536+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:04:51.140536+0000","last_undegraded":"2024-09-22T03:04:51.140536+0000","last_fullsized":"2024-09-22T03:04:51.140536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2064,"log_dups_size":0,"ondisk_log_size":2064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135331840,"num_objects":2065,"num_object_clones":0,"num_object_copies":6195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2065,"num_write_kb":132160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'2142","reported_seq":2179,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:54.188579+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:04:54.188579+0000","last_peered":"2024-09-22T03:04:54.188579+0000","last_clean":"2024-09-22T03:04:54.188579+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:04:54.188579+0000","last_undegraded":"2024-09-22T03:04:54.188579+0000","last_fullsized":"2024-09-22T03:04:54.188579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2142,"log_dups_size":0,"ondisk_log_size":2142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140443648,"num_objects":2143,"num_object_clones":0,"num_object_copies":6429,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2143,"num_write_kb":137152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'2240","reported_seq":2277,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:54.289369+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:04:54.289369+0000","last_peered":"2024-09-22T03:04:54.289369+0000","last_clean":"2024-09-22T03:04:54.289369+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:04:54.289369+0000","last_undegraded":"2024-09-22T03:04:54.289369+0000","last_fullsized":"2024-09-22T03:04:54.289369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2240,"log_dups_size":0,"ondisk_log_size":2240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146866176,"num_objects":2241,"num_object_clones":0,"num_object_copies":6723,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2241,"num_write_kb":143424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'2094","reported_seq":2131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.261444+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:04:51.261444+0000","last_peered":"2024-09-22T03:04:51.261444+0000","last_clean":"2024-09-22T03:04:51.261444+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:04:51.261444+0000","last_undegraded":"2024-09-22T03:04:51.261444+0000","last_fullsized":"2024-09-22T03:04:51.261444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2094,"log_dups_size":0,"ondisk_log_size":2094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":137297920,"num_objects":2095,"num_object_clones":0,"num_object_copies":6285,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2095,"num_write_kb":134080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'2133","reported_seq":2170,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.228164+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:04:51.228164+0000","last_peered":"2024-09-22T03:04:51.228164+0000","last_clean":"2024-09-22T03:04:51.228164+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:04:51.228164+0000","last_undegraded":"2024-09-22T03:04:51.228164+0000","last_fullsized":"2024-09-22T03:04:51.228164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2133,"log_dups_size":0,"ondisk_log_size":2133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139853824,"num_objects":2134,"num_object_clones":0,"num_object_copies":6402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2134,"num_write_kb":136576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'1996","reported_seq":2033,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.182371+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:04:51.182371+0000","last_peered":"2024-09-22T03:04:51.182371+0000","last_clean":"2024-09-22T03:04:51.182371+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:04:51.182371+0000","last_undegraded":"2024-09-22T03:04:51.182371+0000","last_fullsized":"2024-09-22T03:04:51.182371+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":1996,"log_dups_size":0,"ondisk_log_size":1996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130875392,"num_objects":1997,"num_object_clones":0,"num_object_copies":5991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1997,"num_write_kb":127808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'2123","reported_seq":2160,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.018462+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:04:51.018462+0000","last_peered":"2024-09-22T03:04:51.018462+0000","last_clean":"2024-09-22T03:04:51.018462+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:04:51.018462+0000","last_undegraded":"2024-09-22T03:04:51.018462+0000","last_fullsized":"2024-09-22T03:04:51.018462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2123,"log_dups_size":0,"ondisk_log_size":2123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139198464,"num_objects":2124,"num_object_clones":0,"num_object_copies":6372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2124,"num_write_kb":135936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'2164","reported_seq":2201,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.203427+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:04:51.203427+0000","last_peered":"2024-09-22T03:04:51.203427+0000","last_clean":"2024-09-22T03:04:51.203427+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:04:51.203427+0000","last_undegraded":"2024-09-22T03:04:51.203427+0000","last_fullsized":"2024-09-22T03:04:51.203427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2164,"log_dups_size":0,"ondisk_log_size":2164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141885440,"num_objects":2165,"num_object_clones":0,"num_object_copies":6495,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2165,"num_write_kb":138560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'2033","reported_seq":2070,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.192617+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:04:51.192617+0000","last_peered":"2024-09-22T03:04:51.192617+0000","last_clean":"2024-09-22T03:04:51.192617+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:04:51.192617+0000","last_undegraded":"2024-09-22T03:04:51.192617+0000","last_fullsized":"2024-09-22T03:04:51.192617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2033,"log_dups_size":0,"ondisk_log_size":2033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133300224,"num_objects":2034,"num_object_clones":0,"num_object_copies":6102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2034,"num_write_kb":130176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'2139","reported_seq":2176,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.320938+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:04:51.320938+0000","last_peered":"2024-09-22T03:04:51.320938+0000","last_clean":"2024-09-22T03:04:51.320938+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:04:51.320938+0000","last_undegraded":"2024-09-22T03:04:51.320938+0000","last_fullsized":"2024-09-22T03:04:51.320938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2139,"log_dups_size":0,"ondisk_log_size":2139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140247040,"num_objects":2140,"num_object_clones":0,"num_object_copies":6420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2140,"num_write_kb":136960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'2079","reported_seq":2116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.295958+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:04:51.295958+0000","last_peered":"2024-09-22T03:04:51.295958+0000","last_clean":"2024-09-22T03:04:51.295958+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:04:51.295958+0000","last_undegraded":"2024-09-22T03:04:51.295958+0000","last_fullsized":"2024-09-22T03:04:51.295958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2079,"log_dups_size":0,"ondisk_log_size":2079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136314880,"num_objects":2080,"num_object_clones":0,"num_object_copies":6240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2080,"num_write_kb":133120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2117","reported_seq":2154,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:51.136491+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:04:51.136491+0000","last_peered":"2024-09-22T03:04:51.136491+0000","last_clean":"2024-09-22T03:04:51.136491+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:04:51.136491+0000","last_undegraded":"2024-09-22T03:04:51.136491+0000","last_fullsized":"2024-09-22T03:04:51.136491+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2117,"log_dups_size":0,"ondisk_log_size":2117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138805248,"num_objects":2118,"num_object_clones":0,"num_object_copies":6354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2118,"num_write_kb":135552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2219376640,"num_objects":33865,"num_object_clones":0,"num_object_copies":101595,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33865,"num_write_kb":2167360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":415891456,"data_stored":6654263296,"data_compressed":315976693,"data_compressed_allocated":415891456,"data_compressed_original":6654263296,"omap_allocated":0,"internal_metadata":0},"log_size":33849,"ondisk_log_size":33849,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673065,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":165892,"kb_used_data":116852,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94205948,"statfs":{"total":96636764160,"available":96466890752,"internally_reserved":0,"allocated":119656448,"data_stored":1911163083,"data_compressed":90748068,"data_compressed_allocated":119443456,"data_compressed_original":1911095296,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673065,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":140812,"kb_used_data":91772,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94231028,"statfs":{"total":96636764160,"available":96492572672,"internally_reserved":0,"allocated":93974528,"data_stored":1499859691,"data_compressed":71219319,"data_compressed_allocated":93741056,"data_compressed_original":1499774976,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673065,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154216,"kb_used_data":101016,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94217624,"statfs":{"total":96636764160,"available":96478846976,"internally_reserved":0,"allocated":103440384,"data_stored":1651313387,"data_compressed":78411059,"data_compressed_allocated":103206912,"data_compressed_original":1651228672,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705773,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143528,"kb_used_data":94488,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94228312,"statfs":{"total":96636764160,"available":96489791488,"internally_reserved":0,"allocated":96755712,"data_stored":1544424152,"data_compressed":73335461,"data_compressed_allocated":96526336,"data_compressed_original":1544339456,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":97243136,"data_stored":1555890176,"data_compressed":73881219,"data_compressed_allocated":97243136,"data_compressed_original":1555890176,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":103985152,"data_stored":1663762432,"data_compressed":79003497,"data_compressed_allocated":103985152,"data_compressed_original":1663762432,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94347264,"data_stored":1509556224,"data_compressed":71681053,"data_compressed_allocated":94347264,"data_compressed_original":1509556224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":120315904,"data_stored":1925054464,"data_compressed":91410924,"data_compressed_allocated":120315904,"data_compressed_original":1925054464,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:04:57.483 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 97 16 35453 35437 22.8305 17.6875 0.0729283 0.0437808 2024-09-22T03:04:58.483 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 98 16 35750 35734 22.7869 18.5625 0.0448646 0.0438684 2024-09-22T03:04:58.764 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:04:58.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:58.908+0000 7ff437d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:58.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:04:58.917+0000 7ff437d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:04:59.483 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 99 16 36036 36020 22.7373 17.875 0.0535697 0.0439591 2024-09-22T03:05:00.483 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:2024-09-22T03:05:00.482937+0000 min lat: 0.009172 max lat: 0.177948 avg lat: 0.0440487 2024-09-22T03:05:00.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:05:00.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 100 16 36326 36310 22.6911 18.125 0.0692906 0.0440487 2024-09-22T03:05:01.241 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:01.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:01.390+0000 7f8df9b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:01.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:01.397+0000 7f8df9b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:01.483 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 101 16 36615 36599 22.6453 18.0625 0.0436941 0.0441422 2024-09-22T03:05:01.878 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:01.878 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:01.878 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:05:01.879 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:05:02.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:02.028+0000 7ff321423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:02.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:02.039+0000 7ff321423640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:02.196 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:02.196 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:02.196 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:02.196 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:02.196 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:02.196 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:02.196 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:02.196 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:02.196 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:02.196 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:02.196 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:02.196 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:02.199 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:02.200 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:02.200 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:05:02.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:02.347+0000 7f1f87397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:02.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:02.360+0000 7f1f87397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:02.401 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:02.401 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:02.401 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:02.401 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:02.401 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:02.401 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:02.401 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:02.402 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:02.402 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:02.402 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:02.402 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:02.402 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:02.405 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:02.406 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:02.406 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:05:02.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 102 16 36901 36885 22.5985 17.875 0.0737404 0.0442334 2024-09-22T03:05:02.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:02.557+0000 7ff585597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:02.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:02.571+0000 7ff585597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:02.648 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:02.648 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:02.648 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:02.648 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:02.648 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:02.648 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:02.648 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:02.649 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:02.649 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:02.649 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:02.649 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:02.649 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:02.653 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:02.654 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:02.654 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:05:02.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:02.803+0000 7f73a6b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:02.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:02.816+0000 7f73a6b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:02.842 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:02.842 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:02.842 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:02.842 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:02.843 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:02.843 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:02.843 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:02.843 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:02.843 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:02.843 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:02.843 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:02.843 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:02.846 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:02.847 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:03.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 103 16 37175 37159 22.5453 17.125 0.0939385 0.0443363 2024-09-22T03:05:03.746 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:03.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:03.892+0000 7f137cf17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:03.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:03.900+0000 7f137cf17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:04.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 104 16 37458 37442 22.4986 17.6875 0.0441232 0.0444322 2024-09-22T03:05:05.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 105 16 37737 37721 22.4504 17.4375 0.0402502 0.044528 2024-09-22T03:05:06.207 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:06.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:06.364+0000 7f69a1a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:06.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:06.371+0000 7f69a1a4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:06.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 106 16 38015 37999 22.4025 17.375 0.0571956 0.0446219 2024-09-22T03:05:07.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 107 16 38306 38290 22.3631 18.1875 0.0449019 0.0446982 2024-09-22T03:05:07.848 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:07.848 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:07.848 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:05:08.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:07.997+0000 7f727d157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:08.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:08.009+0000 7f727d157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:08.306 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:05:08.306 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:05:08.324 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":79,"stamp":"2024-09-22T03:05:07.327695+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2481127987,"num_objects":37854,"num_object_clones":0,"num_object_copies":113562,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":37989,"num_write_kb":2424296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37934,"ondisk_log_size":37934,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":665124,"kb_used_data":452324,"kb_used_omap":0,"kb_used_meta":212736,"kb_avail":376822236,"statfs":{"total":386547056640,"available":385865969664,"internally_reserved":0,"allocated":463179776,"data_stored":7396403577,"data_compressed":351210395,"data_compressed_allocated":462270464,"data_compressed_original":7396081664,"omap_allocated":0,"internal_metadata":217841664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":261160960,"num_objects":3985,"num_object_clones":0,"num_object_copies":11955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3985,"num_write_kb":255040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002005"},"pg_stats":[{"pgid":"3.f","version":"25'2327","reported_seq":2364,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:04.121233+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:05:04.121233+0000","last_peered":"2024-09-22T03:05:04.121233+0000","last_clean":"2024-09-22T03:05:04.121233+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:05:04.121233+0000","last_undegraded":"2024-09-22T03:05:04.121233+0000","last_fullsized":"2024-09-22T03:05:04.121233+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2327,"log_dups_size":0,"ondisk_log_size":2327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152567808,"num_objects":2328,"num_object_clones":0,"num_object_copies":6984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2328,"num_write_kb":148992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'2446","reported_seq":2483,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.292402+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:05:06.292402+0000","last_peered":"2024-09-22T03:05:06.292402+0000","last_clean":"2024-09-22T03:05:06.292402+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:05:06.292402+0000","last_undegraded":"2024-09-22T03:05:06.292402+0000","last_fullsized":"2024-09-22T03:05:06.292402+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2446,"log_dups_size":0,"ondisk_log_size":2446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160366592,"num_objects":2447,"num_object_clones":0,"num_object_copies":7341,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2447,"num_write_kb":156608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'2316","reported_seq":2353,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.093280+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:05:06.093280+0000","last_peered":"2024-09-22T03:05:06.093280+0000","last_clean":"2024-09-22T03:05:06.093280+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:05:06.093280+0000","last_undegraded":"2024-09-22T03:05:06.093280+0000","last_fullsized":"2024-09-22T03:05:06.093280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2316,"log_dups_size":0,"ondisk_log_size":2316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151846912,"num_objects":2317,"num_object_clones":0,"num_object_copies":6951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2317,"num_write_kb":148288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'2360","reported_seq":2397,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:04.280798+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:05:04.280798+0000","last_peered":"2024-09-22T03:05:04.280798+0000","last_clean":"2024-09-22T03:05:04.280798+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:05:04.280798+0000","last_undegraded":"2024-09-22T03:05:04.280798+0000","last_fullsized":"2024-09-22T03:05:04.280798+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2360,"log_dups_size":0,"ondisk_log_size":2360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154730496,"num_objects":2361,"num_object_clones":0,"num_object_copies":7083,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2361,"num_write_kb":151104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'2325","reported_seq":2362,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.326269+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:05:06.326269+0000","last_peered":"2024-09-22T03:05:06.326269+0000","last_clean":"2024-09-22T03:05:06.326269+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:05:06.326269+0000","last_undegraded":"2024-09-22T03:05:06.326269+0000","last_fullsized":"2024-09-22T03:05:06.326269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2325,"log_dups_size":0,"ondisk_log_size":2325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152436736,"num_objects":2326,"num_object_clones":0,"num_object_copies":6978,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2326,"num_write_kb":148864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'2337","reported_seq":2374,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:04.228946+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:05:04.228946+0000","last_peered":"2024-09-22T03:05:04.228946+0000","last_clean":"2024-09-22T03:05:04.228946+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:05:04.228946+0000","last_undegraded":"2024-09-22T03:05:04.228946+0000","last_fullsized":"2024-09-22T03:05:04.228946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2337,"log_dups_size":0,"ondisk_log_size":2337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153223168,"num_objects":2338,"num_object_clones":0,"num_object_copies":7014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2338,"num_write_kb":149632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'2406","reported_seq":2443,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:04.182786+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:05:04.182786+0000","last_peered":"2024-09-22T03:05:04.182786+0000","last_clean":"2024-09-22T03:05:04.182786+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:05:04.182786+0000","last_undegraded":"2024-09-22T03:05:04.182786+0000","last_fullsized":"2024-09-22T03:05:04.182786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2406,"log_dups_size":0,"ondisk_log_size":2406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157745152,"num_objects":2407,"num_object_clones":0,"num_object_copies":7221,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2407,"num_write_kb":154048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'2388","reported_seq":2425,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.350964+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:05:06.350964+0000","last_peered":"2024-09-22T03:05:06.350964+0000","last_clean":"2024-09-22T03:05:06.350964+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:05:06.350964+0000","last_undegraded":"2024-09-22T03:05:06.350964+0000","last_fullsized":"2024-09-22T03:05:06.350964+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2388,"log_dups_size":0,"ondisk_log_size":2388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156565504,"num_objects":2389,"num_object_clones":0,"num_object_copies":7167,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2389,"num_write_kb":152896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'2419","reported_seq":2456,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.315466+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:05:06.315466+0000","last_peered":"2024-09-22T03:05:06.315466+0000","last_clean":"2024-09-22T03:05:06.315466+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:05:06.315466+0000","last_undegraded":"2024-09-22T03:05:06.315466+0000","last_fullsized":"2024-09-22T03:05:06.315466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2419,"log_dups_size":0,"ondisk_log_size":2419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158597120,"num_objects":2420,"num_object_clones":0,"num_object_copies":7260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2420,"num_write_kb":154880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'2248","reported_seq":2285,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.323729+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:05:06.323729+0000","last_peered":"2024-09-22T03:05:06.323729+0000","last_clean":"2024-09-22T03:05:06.323729+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:05:06.323729+0000","last_undegraded":"2024-09-22T03:05:06.323729+0000","last_fullsized":"2024-09-22T03:05:06.323729+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2248,"log_dups_size":0,"ondisk_log_size":2248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":147390464,"num_objects":2249,"num_object_clones":0,"num_object_copies":6747,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2249,"num_write_kb":143936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'2386","reported_seq":2423,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:05.998142+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:05:05.998142+0000","last_peered":"2024-09-22T03:05:05.998142+0000","last_clean":"2024-09-22T03:05:05.998142+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:05:05.998142+0000","last_undegraded":"2024-09-22T03:05:05.998142+0000","last_fullsized":"2024-09-22T03:05:05.998142+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2386,"log_dups_size":0,"ondisk_log_size":2386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156434432,"num_objects":2387,"num_object_clones":0,"num_object_copies":7161,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2387,"num_write_kb":152768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'2419","reported_seq":2456,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.225349+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:05:06.225349+0000","last_peered":"2024-09-22T03:05:06.225349+0000","last_clean":"2024-09-22T03:05:06.225349+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:05:06.225349+0000","last_undegraded":"2024-09-22T03:05:06.225349+0000","last_fullsized":"2024-09-22T03:05:06.225349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2419,"log_dups_size":0,"ondisk_log_size":2419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158597120,"num_objects":2420,"num_object_clones":0,"num_object_copies":7260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2420,"num_write_kb":154880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'2296","reported_seq":2333,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.280846+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:05:06.280846+0000","last_peered":"2024-09-22T03:05:06.280846+0000","last_clean":"2024-09-22T03:05:06.280846+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:05:06.280846+0000","last_undegraded":"2024-09-22T03:05:06.280846+0000","last_fullsized":"2024-09-22T03:05:06.280846+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2296,"log_dups_size":0,"ondisk_log_size":2296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":150536192,"num_objects":2297,"num_object_clones":0,"num_object_copies":6891,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2297,"num_write_kb":147008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'2409","reported_seq":2446,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.306574+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:05:06.306574+0000","last_peered":"2024-09-22T03:05:06.306574+0000","last_clean":"2024-09-22T03:05:06.306574+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:05:06.306574+0000","last_undegraded":"2024-09-22T03:05:06.306574+0000","last_fullsized":"2024-09-22T03:05:06.306574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2409,"log_dups_size":0,"ondisk_log_size":2409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157941760,"num_objects":2410,"num_object_clones":0,"num_object_copies":7230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2410,"num_write_kb":154240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'2341","reported_seq":2378,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.331637+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:05:06.331637+0000","last_peered":"2024-09-22T03:05:06.331637+0000","last_clean":"2024-09-22T03:05:06.331637+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:05:06.331637+0000","last_undegraded":"2024-09-22T03:05:06.331637+0000","last_fullsized":"2024-09-22T03:05:06.331637+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2341,"log_dups_size":0,"ondisk_log_size":2341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153485312,"num_objects":2342,"num_object_clones":0,"num_object_copies":7026,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2342,"num_write_kb":149888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2411","reported_seq":2448,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:06.286335+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:05:06.286335+0000","last_peered":"2024-09-22T03:05:06.286335+0000","last_clean":"2024-09-22T03:05:06.286335+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:05:06.286335+0000","last_undegraded":"2024-09-22T03:05:06.286335+0000","last_fullsized":"2024-09-22T03:05:06.286335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2411,"log_dups_size":0,"ondisk_log_size":2411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158072832,"num_objects":2412,"num_object_clones":0,"num_object_copies":7236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2412,"num_write_kb":154368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2480537600,"num_objects":37850,"num_object_clones":0,"num_object_copies":113550,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37850,"num_write_kb":2422400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":465121280,"data_stored":7441940480,"data_compressed":353379821,"data_compressed_allocated":465121280,"data_compressed_original":7441940480,"omap_allocated":0,"internal_metadata":0},"log_size":37834,"ondisk_log_size":37834,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":181116,"kb_used_data":132076,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94190724,"statfs":{"total":96636764160,"available":96451301376,"internally_reserved":0,"allocated":135245824,"data_stored":2160593099,"data_compressed":102592340,"data_compressed_allocated":135032832,"data_compressed_original":2160525312,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":161116,"kb_used_data":103756,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94210724,"statfs":{"total":96636764160,"available":96471781376,"internally_reserved":0,"allocated":106246144,"data_stored":1696205547,"data_compressed":80542871,"data_compressed_allocated":106012672,"data_compressed_original":1696120832,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673080,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":163212,"kb_used_data":114172,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94208628,"statfs":{"total":96636764160,"available":96469635072,"internally_reserved":0,"allocated":116912128,"data_stored":1866861291,"data_compressed":88646427,"data_compressed_allocated":116678656,"data_compressed_original":1866776576,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":159680,"kb_used_data":102320,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94212160,"statfs":{"total":96636764160,"available":96473251840,"internally_reserved":0,"allocated":104775680,"data_stored":1672743640,"data_compressed":79428757,"data_compressed_allocated":104546304,"data_compressed_original":1672658944,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":105168896,"data_stored":1682702336,"data_compressed":79902939,"data_compressed_allocated":105168896,"data_compressed_original":1682702336,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":117387264,"data_stored":1878196224,"data_compressed":89185961,"data_compressed_allocated":117387264,"data_compressed_original":1878196224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106696704,"data_stored":1707147264,"data_compressed":81063733,"data_compressed_allocated":106696704,"data_compressed_original":1707147264,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":135868416,"data_stored":2173894656,"data_compressed":103227188,"data_compressed_allocated":135868416,"data_compressed_original":2173894656,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:05:08.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 108 16 38588 38572 22.3192 17.625 0.0408541 0.0447874 2024-09-22T03:05:08.624 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:08.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:08.774+0000 7f30a4597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:08.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:08.781+0000 7f30a4597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:09.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 109 16 38857 38841 22.2687 16.8125 0.0734967 0.0448921 2024-09-22T03:05:10.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 110 16 39132 39116 22.2225 17.1875 0.0758475 0.0449733 2024-09-22T03:05:11.064 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:11.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:11.213+0000 7fdc2b458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:11.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:11.220+0000 7fdc2b458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:11.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 111 16 39423 39407 22.1861 18.1875 0.073227 0.0450562 2024-09-22T03:05:12.485 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 112 16 39696 39680 22.1404 17.0625 0.0302261 0.0451518 2024-09-22T03:05:13.326 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:13.326 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:13.327 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:05:13.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 113 16 39886 39870 22.0495 11.875 0.0768674 0.0453313 2024-09-22T03:05:13.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:13.484+0000 7f2570597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:13.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:13.492+0000 7f2570597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:13.551 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:13.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:13.700+0000 7fa4882ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:13.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:13.707+0000 7fa4882ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:13.785 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:05:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:05:13.806 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-09-22T03:05:13.328761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2571436595,"num_objects":39232,"num_object_clones":0,"num_object_copies":117696,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":39367,"num_write_kb":2512488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39312,"ondisk_log_size":39312,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":695740,"kb_used_data":469052,"kb_used_omap":0,"kb_used_meta":226624,"kb_avail":376791620,"statfs":{"total":386547056640,"available":385834618880,"internally_reserved":0,"allocated":480309248,"data_stored":7670475129,"data_compressed":364224779,"data_compressed_allocated":479399936,"data_compressed_original":7670153216,"omap_allocated":0,"internal_metadata":232062976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":254607360,"num_objects":3885,"num_object_clones":0,"num_object_copies":11655,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3885,"num_write_kb":248640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002081"},"pg_stats":[{"pgid":"3.f","version":"25'2413","reported_seq":2450,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:09.276271+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:05:09.276271+0000","last_peered":"2024-09-22T03:05:09.276271+0000","last_clean":"2024-09-22T03:05:09.276271+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:05:09.276271+0000","last_undegraded":"2024-09-22T03:05:09.276271+0000","last_fullsized":"2024-09-22T03:05:09.276271+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2413,"log_dups_size":0,"ondisk_log_size":2413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158203904,"num_objects":2414,"num_object_clones":0,"num_object_copies":7242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2414,"num_write_kb":154496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'2539","reported_seq":2576,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:11.269995+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:05:11.269995+0000","last_peered":"2024-09-22T03:05:11.269995+0000","last_clean":"2024-09-22T03:05:11.269995+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:05:11.269995+0000","last_undegraded":"2024-09-22T03:05:11.269995+0000","last_fullsized":"2024-09-22T03:05:11.269995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2539,"log_dups_size":0,"ondisk_log_size":2539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166461440,"num_objects":2540,"num_object_clones":0,"num_object_copies":7620,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2540,"num_write_kb":162560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'2404","reported_seq":2441,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:11.288703+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:05:11.288703+0000","last_peered":"2024-09-22T03:05:11.288703+0000","last_clean":"2024-09-22T03:05:11.288703+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:05:11.288703+0000","last_undegraded":"2024-09-22T03:05:11.288703+0000","last_fullsized":"2024-09-22T03:05:11.288703+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2404,"log_dups_size":0,"ondisk_log_size":2404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":157614080,"num_objects":2405,"num_object_clones":0,"num_object_copies":7215,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2405,"num_write_kb":153920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'2445","reported_seq":2482,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:09.263086+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:05:09.263086+0000","last_peered":"2024-09-22T03:05:09.263086+0000","last_clean":"2024-09-22T03:05:09.263086+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:05:09.263086+0000","last_undegraded":"2024-09-22T03:05:09.263086+0000","last_fullsized":"2024-09-22T03:05:09.263086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2445,"log_dups_size":0,"ondisk_log_size":2445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160301056,"num_objects":2446,"num_object_clones":0,"num_object_copies":7338,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2446,"num_write_kb":156544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'2420","reported_seq":2457,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:11.266630+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:05:11.266630+0000","last_peered":"2024-09-22T03:05:11.266630+0000","last_clean":"2024-09-22T03:05:11.266630+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:05:11.266630+0000","last_undegraded":"2024-09-22T03:05:11.266630+0000","last_fullsized":"2024-09-22T03:05:11.266630+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2420,"log_dups_size":0,"ondisk_log_size":2420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158662656,"num_objects":2421,"num_object_clones":0,"num_object_copies":7263,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2421,"num_write_kb":154944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'2433","reported_seq":2470,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:09.254961+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:05:09.254961+0000","last_peered":"2024-09-22T03:05:09.254961+0000","last_clean":"2024-09-22T03:05:09.254961+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:05:09.254961+0000","last_undegraded":"2024-09-22T03:05:09.254961+0000","last_fullsized":"2024-09-22T03:05:09.254961+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2433,"log_dups_size":0,"ondisk_log_size":2433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159514624,"num_objects":2434,"num_object_clones":0,"num_object_copies":7302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2434,"num_write_kb":155776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'2479","reported_seq":2516,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:09.278340+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:05:09.278340+0000","last_peered":"2024-09-22T03:05:09.278340+0000","last_clean":"2024-09-22T03:05:09.278340+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:05:09.278340+0000","last_undegraded":"2024-09-22T03:05:09.278340+0000","last_fullsized":"2024-09-22T03:05:09.278340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2479,"log_dups_size":0,"ondisk_log_size":2479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162529280,"num_objects":2480,"num_object_clones":0,"num_object_copies":7440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2480,"num_write_kb":158720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'2476","reported_seq":2513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:11.275461+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:05:11.275461+0000","last_peered":"2024-09-22T03:05:11.275461+0000","last_clean":"2024-09-22T03:05:11.275461+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:05:11.275461+0000","last_undegraded":"2024-09-22T03:05:11.275461+0000","last_fullsized":"2024-09-22T03:05:11.275461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2476,"log_dups_size":0,"ondisk_log_size":2476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162332672,"num_objects":2477,"num_object_clones":0,"num_object_copies":7431,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2477,"num_write_kb":158528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'2488","reported_seq":2525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:11.270939+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:05:11.270939+0000","last_peered":"2024-09-22T03:05:11.270939+0000","last_clean":"2024-09-22T03:05:11.270939+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:05:11.270939+0000","last_undegraded":"2024-09-22T03:05:11.270939+0000","last_fullsized":"2024-09-22T03:05:11.270939+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2488,"log_dups_size":0,"ondisk_log_size":2488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163119104,"num_objects":2489,"num_object_clones":0,"num_object_copies":7467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2489,"num_write_kb":159296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'2334","reported_seq":2371,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:11.329597+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:05:11.329597+0000","last_peered":"2024-09-22T03:05:11.329597+0000","last_clean":"2024-09-22T03:05:11.329597+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:05:11.329597+0000","last_undegraded":"2024-09-22T03:05:11.329597+0000","last_fullsized":"2024-09-22T03:05:11.329597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2334,"log_dups_size":0,"ondisk_log_size":2334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153026560,"num_objects":2335,"num_object_clones":0,"num_object_copies":7005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2335,"num_write_kb":149440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'2470","reported_seq":2507,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:11.261348+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:05:11.261348+0000","last_peered":"2024-09-22T03:05:11.261348+0000","last_clean":"2024-09-22T03:05:11.261348+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:05:11.261348+0000","last_undegraded":"2024-09-22T03:05:11.261348+0000","last_fullsized":"2024-09-22T03:05:11.261348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2470,"log_dups_size":0,"ondisk_log_size":2470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161939456,"num_objects":2471,"num_object_clones":0,"num_object_copies":7413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2471,"num_write_kb":158144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'2508","reported_seq":2545,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:11.025350+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:05:11.025350+0000","last_peered":"2024-09-22T03:05:11.025350+0000","last_clean":"2024-09-22T03:05:11.025350+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:05:11.025350+0000","last_undegraded":"2024-09-22T03:05:11.025350+0000","last_fullsized":"2024-09-22T03:05:11.025350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2508,"log_dups_size":0,"ondisk_log_size":2508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164429824,"num_objects":2509,"num_object_clones":0,"num_object_copies":7527,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2509,"num_write_kb":160576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'2383","reported_seq":2420,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:11.321027+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:05:11.321027+0000","last_peered":"2024-09-22T03:05:11.321027+0000","last_clean":"2024-09-22T03:05:11.321027+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:05:11.321027+0000","last_undegraded":"2024-09-22T03:05:11.321027+0000","last_fullsized":"2024-09-22T03:05:11.321027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2383,"log_dups_size":0,"ondisk_log_size":2383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":156237824,"num_objects":2384,"num_object_clones":0,"num_object_copies":7152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2384,"num_write_kb":152576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'2498","reported_seq":2535,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:11.310507+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:05:11.310507+0000","last_peered":"2024-09-22T03:05:11.310507+0000","last_clean":"2024-09-22T03:05:11.310507+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:05:11.310507+0000","last_undegraded":"2024-09-22T03:05:11.310507+0000","last_fullsized":"2024-09-22T03:05:11.310507+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2498,"log_dups_size":0,"ondisk_log_size":2498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163774464,"num_objects":2499,"num_object_clones":0,"num_object_copies":7497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2499,"num_write_kb":159936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'2417","reported_seq":2454,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:11.347463+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:05:11.347463+0000","last_peered":"2024-09-22T03:05:11.347463+0000","last_clean":"2024-09-22T03:05:11.347463+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:05:11.347463+0000","last_undegraded":"2024-09-22T03:05:11.347463+0000","last_fullsized":"2024-09-22T03:05:11.347463+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2417,"log_dups_size":0,"ondisk_log_size":2417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158466048,"num_objects":2418,"num_object_clones":0,"num_object_copies":7254,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2418,"num_write_kb":154752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2505","reported_seq":2542,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:11.206618+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:05:11.206618+0000","last_peered":"2024-09-22T03:05:11.206618+0000","last_clean":"2024-09-22T03:05:11.206618+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:05:11.206618+0000","last_undegraded":"2024-09-22T03:05:11.206618+0000","last_fullsized":"2024-09-22T03:05:11.206618+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2505,"log_dups_size":0,"ondisk_log_size":2505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164233216,"num_objects":2506,"num_object_clones":0,"num_object_copies":7518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2506,"num_write_kb":160384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2570846208,"num_objects":39228,"num_object_clones":0,"num_object_copies":117684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39228,"num_write_kb":2510592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":482299904,"data_stored":7716798464,"data_compressed":366431549,"data_compressed_allocated":482299904,"data_compressed_original":7716798464,"omap_allocated":0,"internal_metadata":0},"log_size":39212,"ondisk_log_size":39212,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673085,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":208192,"kb_used_data":136944,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94163648,"statfs":{"total":96636764160,"available":96423575552,"internally_reserved":0,"allocated":140230656,"data_stored":2240350411,"data_compressed":106379644,"data_compressed_allocated":140017664,"data_compressed_original":2240282624,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673085,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":152516,"kb_used_data":107636,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94219324,"statfs":{"total":96636764160,"available":96480587776,"internally_reserved":0,"allocated":110219264,"data_stored":1759775467,"data_compressed":83561511,"data_compressed_allocated":109985792,"data_compressed_original":1759690752,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673085,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":171652,"kb_used_data":118452,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94200188,"statfs":{"total":96636764160,"available":96460992512,"internally_reserved":0,"allocated":121294848,"data_stored":1936984811,"data_compressed":91976267,"data_compressed_allocated":121061376,"data_compressed_original":1936900096,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":163380,"kb_used_data":106020,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94208460,"statfs":{"total":96636764160,"available":96469463040,"internally_reserved":0,"allocated":108564480,"data_stored":1733364440,"data_compressed":82307357,"data_compressed_allocated":108335104,"data_compressed_original":1733279744,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":108957696,"data_stored":1743323136,"data_compressed":82781539,"data_compressed_allocated":108957696,"data_compressed_original":1743323136,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":121778176,"data_stored":1948450816,"data_compressed":92522025,"data_compressed_allocated":121778176,"data_compressed_original":1948450816,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110690304,"data_stored":1771044864,"data_compressed":84097933,"data_compressed_allocated":110690304,"data_compressed_original":1771044864,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":140873728,"data_stored":2253979648,"data_compressed":107030052,"data_compressed_allocated":140873728,"data_compressed_original":2253979648,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:05:14.484 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 114 16 40153 40137 22.0025 16.6875 0.0474329 0.0454334 2024-09-22T03:05:15.485 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 115 16 40433 40417 21.9633 17.5 0.0507552 0.0455072 2024-09-22T03:05:16.099 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:16.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:16.247+0000 7f5984e58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:16.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:16.254+0000 7f5984e58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:16.485 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 116 16 40711 40695 21.9237 17.375 0.0485397 0.0455933 2024-09-22T03:05:17.485 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 117 16 40989 40973 21.8848 17.375 0.0577018 0.0456798 2024-09-22T03:05:18.485 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 118 16 41272 41256 21.8493 17.6875 0.0384143 0.0457552 2024-09-22T03:05:18.583 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:18.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:18.732+0000 7f0047d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:18.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:18.742+0000 7f0046af5640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:18.808 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:18.808 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:18.808 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:05:18.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:18.958+0000 7f2dd7197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:18.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:18.969+0000 7f2dd7197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:19.270 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:05:19.270 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:05:19.290 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-09-22T03:05:17.329551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2656895539,"num_objects":40536,"num_object_clones":0,"num_object_copies":121608,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":40671,"num_write_kb":2595944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40616,"ondisk_log_size":40616,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":711292,"kb_used_data":484604,"kb_used_omap":0,"kb_used_meta":226624,"kb_avail":376776068,"statfs":{"total":386547056640,"available":385818693632,"internally_reserved":0,"allocated":496234496,"data_stored":7925279097,"data_compressed":376324235,"data_compressed_allocated":495325184,"data_compressed_original":7924957184,"omap_allocated":0,"internal_metadata":232062976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":245628928,"num_objects":3748,"num_object_clones":0,"num_object_copies":11244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3748,"num_write_kb":239872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002203"},"pg_stats":[{"pgid":"3.f","version":"25'2503","reported_seq":2540,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:14.025551+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:05:14.025551+0000","last_peered":"2024-09-22T03:05:14.025551+0000","last_clean":"2024-09-22T03:05:14.025551+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:05:14.025551+0000","last_undegraded":"2024-09-22T03:05:14.025551+0000","last_fullsized":"2024-09-22T03:05:14.025551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2503,"log_dups_size":0,"ondisk_log_size":2503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164102144,"num_objects":2504,"num_object_clones":0,"num_object_copies":7512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2504,"num_write_kb":160256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'2616","reported_seq":2653,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.201907+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:05:16.201907+0000","last_peered":"2024-09-22T03:05:16.201907+0000","last_clean":"2024-09-22T03:05:16.201907+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:05:16.201907+0000","last_undegraded":"2024-09-22T03:05:16.201907+0000","last_fullsized":"2024-09-22T03:05:16.201907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2616,"log_dups_size":0,"ondisk_log_size":2616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171507712,"num_objects":2617,"num_object_clones":0,"num_object_copies":7851,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2617,"num_write_kb":167488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'2486","reported_seq":2523,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.228641+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:05:16.228641+0000","last_peered":"2024-09-22T03:05:16.228641+0000","last_clean":"2024-09-22T03:05:16.228641+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:05:16.228641+0000","last_undegraded":"2024-09-22T03:05:16.228641+0000","last_fullsized":"2024-09-22T03:05:16.228641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2486,"log_dups_size":0,"ondisk_log_size":2486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162988032,"num_objects":2487,"num_object_clones":0,"num_object_copies":7461,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2487,"num_write_kb":159168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'2520","reported_seq":2557,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:14.262623+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:05:14.262623+0000","last_peered":"2024-09-22T03:05:14.262623+0000","last_clean":"2024-09-22T03:05:14.262623+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:05:14.262623+0000","last_undegraded":"2024-09-22T03:05:14.262623+0000","last_fullsized":"2024-09-22T03:05:14.262623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2520,"log_dups_size":0,"ondisk_log_size":2520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165216256,"num_objects":2521,"num_object_clones":0,"num_object_copies":7563,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2521,"num_write_kb":161344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'2496","reported_seq":2533,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.304051+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:05:16.304051+0000","last_peered":"2024-09-22T03:05:16.304051+0000","last_clean":"2024-09-22T03:05:16.304051+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:05:16.304051+0000","last_undegraded":"2024-09-22T03:05:16.304051+0000","last_fullsized":"2024-09-22T03:05:16.304051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2496,"log_dups_size":0,"ondisk_log_size":2496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163643392,"num_objects":2497,"num_object_clones":0,"num_object_copies":7491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2497,"num_write_kb":159808,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'2525","reported_seq":2562,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:14.241158+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:05:14.241158+0000","last_peered":"2024-09-22T03:05:14.241158+0000","last_clean":"2024-09-22T03:05:14.241158+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:05:14.241158+0000","last_undegraded":"2024-09-22T03:05:14.241158+0000","last_fullsized":"2024-09-22T03:05:14.241158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2525,"log_dups_size":0,"ondisk_log_size":2525,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165543936,"num_objects":2526,"num_object_clones":0,"num_object_copies":7578,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2526,"num_write_kb":161664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'2577","reported_seq":2614,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:14.117905+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:05:14.117905+0000","last_peered":"2024-09-22T03:05:14.117905+0000","last_clean":"2024-09-22T03:05:14.117905+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:05:14.117905+0000","last_undegraded":"2024-09-22T03:05:14.117905+0000","last_fullsized":"2024-09-22T03:05:14.117905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2577,"log_dups_size":0,"ondisk_log_size":2577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168951808,"num_objects":2578,"num_object_clones":0,"num_object_copies":7734,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2578,"num_write_kb":164992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'2542","reported_seq":2579,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.272213+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:05:16.272213+0000","last_peered":"2024-09-22T03:05:16.272213+0000","last_clean":"2024-09-22T03:05:16.272213+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:05:16.272213+0000","last_undegraded":"2024-09-22T03:05:16.272213+0000","last_fullsized":"2024-09-22T03:05:16.272213+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2542,"log_dups_size":0,"ondisk_log_size":2542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166658048,"num_objects":2543,"num_object_clones":0,"num_object_copies":7629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2543,"num_write_kb":162752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'2566","reported_seq":2603,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.327687+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:05:16.327687+0000","last_peered":"2024-09-22T03:05:16.327687+0000","last_clean":"2024-09-22T03:05:16.327687+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:05:16.327687+0000","last_undegraded":"2024-09-22T03:05:16.327687+0000","last_fullsized":"2024-09-22T03:05:16.327687+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2566,"log_dups_size":0,"ondisk_log_size":2566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168230912,"num_objects":2567,"num_object_clones":0,"num_object_copies":7701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2567,"num_write_kb":164288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'2412","reported_seq":2449,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.217154+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:05:16.217154+0000","last_peered":"2024-09-22T03:05:16.217154+0000","last_clean":"2024-09-22T03:05:16.217154+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:05:16.217154+0000","last_undegraded":"2024-09-22T03:05:16.217154+0000","last_fullsized":"2024-09-22T03:05:16.217154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2412,"log_dups_size":0,"ondisk_log_size":2412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158138368,"num_objects":2413,"num_object_clones":0,"num_object_copies":7239,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2413,"num_write_kb":154432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'2548","reported_seq":2585,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.336886+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:05:16.336886+0000","last_peered":"2024-09-22T03:05:16.336886+0000","last_clean":"2024-09-22T03:05:16.336886+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:05:16.336886+0000","last_undegraded":"2024-09-22T03:05:16.336886+0000","last_fullsized":"2024-09-22T03:05:16.336886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2548,"log_dups_size":0,"ondisk_log_size":2548,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167051264,"num_objects":2549,"num_object_clones":0,"num_object_copies":7647,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2549,"num_write_kb":163136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'2595","reported_seq":2632,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.343054+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:05:16.343054+0000","last_peered":"2024-09-22T03:05:16.343054+0000","last_clean":"2024-09-22T03:05:16.343054+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:05:16.343054+0000","last_undegraded":"2024-09-22T03:05:16.343054+0000","last_fullsized":"2024-09-22T03:05:16.343054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2595,"log_dups_size":0,"ondisk_log_size":2595,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170131456,"num_objects":2596,"num_object_clones":0,"num_object_copies":7788,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2596,"num_write_kb":166144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'2457","reported_seq":2494,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.244550+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:05:16.244550+0000","last_peered":"2024-09-22T03:05:16.244550+0000","last_clean":"2024-09-22T03:05:16.244550+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:05:16.244550+0000","last_undegraded":"2024-09-22T03:05:16.244550+0000","last_fullsized":"2024-09-22T03:05:16.244550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2457,"log_dups_size":0,"ondisk_log_size":2457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161087488,"num_objects":2458,"num_object_clones":0,"num_object_copies":7374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2458,"num_write_kb":157312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'2590","reported_seq":2627,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.198484+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:05:16.198484+0000","last_peered":"2024-09-22T03:05:16.198484+0000","last_clean":"2024-09-22T03:05:16.198484+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:05:16.198484+0000","last_undegraded":"2024-09-22T03:05:16.198484+0000","last_fullsized":"2024-09-22T03:05:16.198484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2590,"log_dups_size":0,"ondisk_log_size":2590,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169803776,"num_objects":2591,"num_object_clones":0,"num_object_copies":7773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2591,"num_write_kb":165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'2498","reported_seq":2535,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.298250+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:05:16.298250+0000","last_peered":"2024-09-22T03:05:16.298250+0000","last_clean":"2024-09-22T03:05:16.298250+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:05:16.298250+0000","last_undegraded":"2024-09-22T03:05:16.298250+0000","last_fullsized":"2024-09-22T03:05:16.298250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2498,"log_dups_size":0,"ondisk_log_size":2498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163774464,"num_objects":2499,"num_object_clones":0,"num_object_copies":7497,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2499,"num_write_kb":159936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2585","reported_seq":2622,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:16.239885+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:05:16.239885+0000","last_peered":"2024-09-22T03:05:16.239885+0000","last_clean":"2024-09-22T03:05:16.239885+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:05:16.239885+0000","last_undegraded":"2024-09-22T03:05:16.239885+0000","last_fullsized":"2024-09-22T03:05:16.239885+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2585,"log_dups_size":0,"ondisk_log_size":2585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169476096,"num_objects":2586,"num_object_clones":0,"num_object_copies":7758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2586,"num_write_kb":165504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2656305152,"num_objects":40532,"num_object_clones":0,"num_object_copies":121596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40532,"num_write_kb":2594048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":498139136,"data_stored":7970226176,"data_compressed":378465653,"data_compressed_allocated":498139136,"data_compressed_original":7970226176,"omap_allocated":0,"internal_metadata":0},"log_size":40516,"ondisk_log_size":40516,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":216800,"kb_used_data":141392,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94155040,"statfs":{"total":96636764160,"available":96414760960,"internally_reserved":0,"allocated":144785408,"data_stored":2313226443,"data_compressed":109840188,"data_compressed_allocated":144572416,"data_compressed_original":2313158656,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":160220,"kb_used_data":111180,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94211620,"statfs":{"total":96636764160,"available":96472698880,"internally_reserved":0,"allocated":113848320,"data_stored":1817840363,"data_compressed":86318743,"data_compressed_allocated":113614848,"data_compressed_original":1817755648,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":179716,"kb_used_data":122356,"kb_used_omap":0,"kb_used_meta":57344,"kb_avail":94192124,"statfs":{"total":96636764160,"available":96452734976,"internally_reserved":0,"allocated":125292544,"data_stored":2000947947,"data_compressed":95013579,"data_compressed_allocated":125059072,"data_compressed_original":2000863232,"omap_allocated":0,"internal_metadata":58720256},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705793,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":154556,"kb_used_data":109676,"kb_used_omap":0,"kb_used_meta":44864,"kb_avail":94217284,"statfs":{"total":96636764160,"available":96478498816,"internally_reserved":0,"allocated":112308224,"data_stored":1793264344,"data_compressed":85151725,"data_compressed_allocated":112078848,"data_compressed_original":1793179648,"omap_allocated":0,"internal_metadata":45940736},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":112705536,"data_stored":1803288576,"data_compressed":85629019,"data_compressed_allocated":112705536,"data_compressed_original":1803288576,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":125767680,"data_stored":2012282880,"data_compressed":95553113,"data_compressed_allocated":125767680,"data_compressed_original":2012282880,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114282496,"data_stored":1828519936,"data_compressed":86827157,"data_compressed_allocated":114282496,"data_compressed_original":1828519936,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":145383424,"data_stored":2326134784,"data_compressed":110456364,"data_compressed_allocated":145383424,"data_compressed_original":2326134784,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:05:19.485 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 119 16 41535 41519 21.8038 16.4375 0.0636626 0.0458483 2024-09-22T03:05:20.485 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:2024-09-22T03:05:20.484703+0000 min lat: 0.009172 max lat: 0.376878 avg lat: 0.0459325 2024-09-22T03:05:20.486 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:05:20.486 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 120 16 41805 41789 21.7627 16.875 0.0495637 0.0459325 2024-09-22T03:05:21.255 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:21.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:21.396+0000 7f5697e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:21.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:21.410+0000 7f5697e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:21.485 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 121 16 42084 42068 21.7269 17.4375 0.0607271 0.0460074 2024-09-22T03:05:22.486 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 122 16 42354 42338 21.6872 16.875 0.100852 0.0460904 2024-09-22T03:05:23.485 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 123 16 42630 42614 21.6511 17.25 0.0275594 0.0461718 2024-09-22T03:05:23.600 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:23.742+0000 7f757ad97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:23.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:23.751+0000 7f757ad97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:24.291 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:24.291 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:24.292 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:05:24.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:24.433+0000 7f609a797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:24.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:24.446+0000 7f609a797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:24.485 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 124 16 42895 42879 21.61 16.5625 0.0347708 0.0462543 2024-09-22T03:05:24.780 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:05:24.781 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:05:24.798 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-09-22T03:05:23.330664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2746286643,"num_objects":41900,"num_object_clones":0,"num_object_copies":125700,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":42035,"num_write_kb":2683240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41980,"ondisk_log_size":41980,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":744492,"kb_used_data":501164,"kb_used_omap":0,"kb_used_meta":243264,"kb_avail":376742868,"statfs":{"total":386547056640,"available":385784696832,"internally_reserved":0,"allocated":513191936,"data_stored":8196598137,"data_compressed":389207915,"data_compressed_allocated":512282624,"data_compressed_original":8196276224,"omap_allocated":0,"internal_metadata":249102336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":242876416,"num_objects":3706,"num_object_clones":0,"num_object_copies":11118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3706,"num_write_kb":237184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002284"},"pg_stats":[{"pgid":"3.f","version":"25'2586","reported_seq":2623,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:19.187432+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:05:19.187432+0000","last_peered":"2024-09-22T03:05:19.187432+0000","last_clean":"2024-09-22T03:05:19.187432+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:05:19.187432+0000","last_undegraded":"2024-09-22T03:05:19.187432+0000","last_fullsized":"2024-09-22T03:05:19.187432+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2586,"log_dups_size":0,"ondisk_log_size":2586,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169541632,"num_objects":2587,"num_object_clones":0,"num_object_copies":7761,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2587,"num_write_kb":165568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'2710","reported_seq":2747,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:21.090101+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:05:21.090101+0000","last_peered":"2024-09-22T03:05:21.090101+0000","last_clean":"2024-09-22T03:05:21.090101+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:05:21.090101+0000","last_undegraded":"2024-09-22T03:05:21.090101+0000","last_fullsized":"2024-09-22T03:05:21.090101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2710,"log_dups_size":0,"ondisk_log_size":2710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177668096,"num_objects":2711,"num_object_clones":0,"num_object_copies":8133,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2711,"num_write_kb":173504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'2566","reported_seq":2603,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:21.323252+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:05:21.323252+0000","last_peered":"2024-09-22T03:05:21.323252+0000","last_clean":"2024-09-22T03:05:21.323252+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:05:21.323252+0000","last_undegraded":"2024-09-22T03:05:21.323252+0000","last_fullsized":"2024-09-22T03:05:21.323252+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2566,"log_dups_size":0,"ondisk_log_size":2566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168230912,"num_objects":2567,"num_object_clones":0,"num_object_copies":7701,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2567,"num_write_kb":164288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'2609","reported_seq":2646,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:19.242550+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:05:19.242550+0000","last_peered":"2024-09-22T03:05:19.242550+0000","last_clean":"2024-09-22T03:05:19.242550+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:05:19.242550+0000","last_undegraded":"2024-09-22T03:05:19.242550+0000","last_fullsized":"2024-09-22T03:05:19.242550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2609,"log_dups_size":0,"ondisk_log_size":2609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171048960,"num_objects":2610,"num_object_clones":0,"num_object_copies":7830,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2610,"num_write_kb":167040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'2585","reported_seq":2622,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:21.245032+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:05:21.245032+0000","last_peered":"2024-09-22T03:05:21.245032+0000","last_clean":"2024-09-22T03:05:21.245032+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:05:21.245032+0000","last_undegraded":"2024-09-22T03:05:21.245032+0000","last_fullsized":"2024-09-22T03:05:21.245032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2585,"log_dups_size":0,"ondisk_log_size":2585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169476096,"num_objects":2586,"num_object_clones":0,"num_object_copies":7758,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2586,"num_write_kb":165504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'2604","reported_seq":2641,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:19.276248+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:05:19.276248+0000","last_peered":"2024-09-22T03:05:19.276248+0000","last_clean":"2024-09-22T03:05:19.276248+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:05:19.276248+0000","last_undegraded":"2024-09-22T03:05:19.276248+0000","last_fullsized":"2024-09-22T03:05:19.276248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2604,"log_dups_size":0,"ondisk_log_size":2604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170721280,"num_objects":2605,"num_object_clones":0,"num_object_copies":7815,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2605,"num_write_kb":166720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'2674","reported_seq":2711,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:19.184385+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:05:19.184385+0000","last_peered":"2024-09-22T03:05:19.184385+0000","last_clean":"2024-09-22T03:05:19.184385+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:05:19.184385+0000","last_undegraded":"2024-09-22T03:05:19.184385+0000","last_fullsized":"2024-09-22T03:05:19.184385+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2674,"log_dups_size":0,"ondisk_log_size":2674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175308800,"num_objects":2675,"num_object_clones":0,"num_object_copies":8025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2675,"num_write_kb":171200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'2625","reported_seq":2662,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:21.276527+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:05:21.276527+0000","last_peered":"2024-09-22T03:05:21.276527+0000","last_clean":"2024-09-22T03:05:21.276527+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:05:21.276527+0000","last_undegraded":"2024-09-22T03:05:21.276527+0000","last_fullsized":"2024-09-22T03:05:21.276527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2625,"log_dups_size":0,"ondisk_log_size":2625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172097536,"num_objects":2626,"num_object_clones":0,"num_object_copies":7878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2626,"num_write_kb":168064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'2652","reported_seq":2689,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:21.090921+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:05:21.090921+0000","last_peered":"2024-09-22T03:05:21.090921+0000","last_clean":"2024-09-22T03:05:21.090921+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:05:21.090921+0000","last_undegraded":"2024-09-22T03:05:21.090921+0000","last_fullsized":"2024-09-22T03:05:21.090921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2652,"log_dups_size":0,"ondisk_log_size":2652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173867008,"num_objects":2653,"num_object_clones":0,"num_object_copies":7959,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2653,"num_write_kb":169792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'2517","reported_seq":2554,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:21.307847+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:05:21.307847+0000","last_peered":"2024-09-22T03:05:21.307847+0000","last_clean":"2024-09-22T03:05:21.307847+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:05:21.307847+0000","last_undegraded":"2024-09-22T03:05:21.307847+0000","last_fullsized":"2024-09-22T03:05:21.307847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2517,"log_dups_size":0,"ondisk_log_size":2517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165019648,"num_objects":2518,"num_object_clones":0,"num_object_copies":7554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2518,"num_write_kb":161152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'2626","reported_seq":2663,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:21.219064+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:05:21.219064+0000","last_peered":"2024-09-22T03:05:21.219064+0000","last_clean":"2024-09-22T03:05:21.219064+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:05:21.219064+0000","last_undegraded":"2024-09-22T03:05:21.219064+0000","last_fullsized":"2024-09-22T03:05:21.219064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2626,"log_dups_size":0,"ondisk_log_size":2626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172163072,"num_objects":2627,"num_object_clones":0,"num_object_copies":7881,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2627,"num_write_kb":168128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'2670","reported_seq":2707,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:21.273081+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:05:21.273081+0000","last_peered":"2024-09-22T03:05:21.273081+0000","last_clean":"2024-09-22T03:05:21.273081+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:05:21.273081+0000","last_undegraded":"2024-09-22T03:05:21.273081+0000","last_fullsized":"2024-09-22T03:05:21.273081+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2670,"log_dups_size":0,"ondisk_log_size":2670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175046656,"num_objects":2671,"num_object_clones":0,"num_object_copies":8013,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2671,"num_write_kb":170944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'2528","reported_seq":2565,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:21.307670+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:05:21.307670+0000","last_peered":"2024-09-22T03:05:21.307670+0000","last_clean":"2024-09-22T03:05:21.307670+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:05:21.307670+0000","last_undegraded":"2024-09-22T03:05:21.307670+0000","last_fullsized":"2024-09-22T03:05:21.307670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2528,"log_dups_size":0,"ondisk_log_size":2528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165740544,"num_objects":2529,"num_object_clones":0,"num_object_copies":7587,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2529,"num_write_kb":161856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'2659","reported_seq":2696,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:21.258000+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:05:21.258000+0000","last_peered":"2024-09-22T03:05:21.258000+0000","last_clean":"2024-09-22T03:05:21.258000+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:05:21.258000+0000","last_undegraded":"2024-09-22T03:05:21.258000+0000","last_fullsized":"2024-09-22T03:05:21.258000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2659,"log_dups_size":0,"ondisk_log_size":2659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174325760,"num_objects":2660,"num_object_clones":0,"num_object_copies":7980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2660,"num_write_kb":170240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'2592","reported_seq":2629,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:21.292442+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:05:21.292442+0000","last_peered":"2024-09-22T03:05:21.292442+0000","last_clean":"2024-09-22T03:05:21.292442+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:05:21.292442+0000","last_undegraded":"2024-09-22T03:05:21.292442+0000","last_fullsized":"2024-09-22T03:05:21.292442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2592,"log_dups_size":0,"ondisk_log_size":2592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169934848,"num_objects":2593,"num_object_clones":0,"num_object_copies":7779,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2593,"num_write_kb":165952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'2677","reported_seq":2714,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:21.266197+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:05:21.266197+0000","last_peered":"2024-09-22T03:05:21.266197+0000","last_clean":"2024-09-22T03:05:21.266197+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:05:21.266197+0000","last_undegraded":"2024-09-22T03:05:21.266197+0000","last_fullsized":"2024-09-22T03:05:21.266197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2677,"log_dups_size":0,"ondisk_log_size":2677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175505408,"num_objects":2678,"num_object_clones":0,"num_object_copies":8034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2678,"num_write_kb":171392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2745696256,"num_objects":41896,"num_object_clones":0,"num_object_copies":125688,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41896,"num_write_kb":2681344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":515014656,"data_stored":8240234496,"data_compressed":391287093,"data_compressed_allocated":515014656,"data_compressed_original":8240234496,"omap_allocated":0,"internal_metadata":0},"log_size":41880,"ondisk_log_size":41880,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673095,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":225732,"kb_used_data":146164,"kb_used_omap":0,"kb_used_meta":79552,"kb_avail":94146108,"statfs":{"total":96636764160,"available":96405614592,"internally_reserved":0,"allocated":149671936,"data_stored":2391410891,"data_compressed":113552804,"data_compressed_allocated":149458944,"data_compressed_original":2391343104,"omap_allocated":0,"internal_metadata":81461248},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673095,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":168256,"kb_used_data":115056,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94203584,"statfs":{"total":96636764160,"available":96464470016,"internally_reserved":0,"allocated":117817344,"data_stored":1881344747,"data_compressed":89334271,"data_compressed_allocated":117583872,"data_compressed_original":1881260032,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673095,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":187920,"kb_used_data":126400,"kb_used_omap":0,"kb_used_meta":61504,"kb_avail":94183920,"statfs":{"total":96636764160,"available":96444334080,"internally_reserved":0,"allocated":129433600,"data_stored":2067204843,"data_compressed":98159811,"data_compressed_allocated":129200128,"data_compressed_original":2067120128,"omap_allocated":0,"internal_metadata":62980096},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705798,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":162584,"kb_used_data":113544,"kb_used_omap":0,"kb_used_meta":49024,"kb_avail":94209256,"statfs":{"total":96636764160,"available":96470278144,"internally_reserved":0,"allocated":116269056,"data_stored":1856637656,"data_compressed":88161029,"data_compressed_allocated":116039680,"data_compressed_original":1856552960,"omap_allocated":0,"internal_metadata":50200576},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":116613120,"data_stored":1865809920,"data_compressed":88597867,"data_compressed_allocated":116613120,"data_compressed_original":1865809920,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129880064,"data_stored":2078081024,"data_compressed":98677561,"data_compressed_allocated":129880064,"data_compressed_original":2078081024,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":118255616,"data_stored":1892089856,"data_compressed":89845797,"data_compressed_allocated":118255616,"data_compressed_original":1892089856,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":150265856,"data_stored":2404253696,"data_compressed":114165868,"data_compressed_allocated":150265856,"data_compressed_original":2404253696,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:05:25.485 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 125 16 43164 43148 21.5716 16.8125 0.0600353 0.0463393 2024-09-22T03:05:26.080 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:26.227+0000 7fee3b823640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:26.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:26.234+0000 7fee3b823640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:26.486 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 126 16 43428 43412 21.5314 16.5 0.0516969 0.046428 2024-09-22T03:05:27.486 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 127 16 43704 43688 21.4976 17.25 0.0609742 0.0464965 2024-09-22T03:05:28.486 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 128 16 43971 43955 21.4601 16.6875 0.046517 0.0465824 2024-09-22T03:05:28.511 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:28.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:28.653+0000 7fe4f3597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:28.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:28.661+0000 7fe4f3597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:29.486 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 129 16 44229 44213 21.4187 16.125 0.0460741 0.0466747 2024-09-22T03:05:29.800 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:29.800 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:29.800 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:05:29.800 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:05:29.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:29.939+0000 7f83bfb17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:29.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:29.949+0000 7f83bfb17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:29.974 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:29.974 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:29.974 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:29.974 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:29.974 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:29.974 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:29.974 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:29.974 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:29.974 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:29.974 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:29.975 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:29.975 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:29.981 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:29.981 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:29.981 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:05:30.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:30.121+0000 7f27b602c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:30.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:30.138+0000 7f27b602c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:30.209 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:30.209 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:30.209 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:30.209 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:30.209 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:30.209 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:30.210 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:30.213 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:30.213 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:30.214 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:05:30.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:30.357+0000 7f50dccd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:30.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:30.369+0000 7f50dccd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:30.401 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:30.401 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:30.402 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:05:30.486 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 130 16 44478 44462 21.3736 15.5625 0.0814818 0.046773 2024-09-22T03:05:30.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:30.551+0000 7fec8dec3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:30.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:30.561+0000 7fec8dec3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:30.584 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:30.586 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:30.586 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:31.034 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:31.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:31.184+0000 7fb0bee6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:31.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:31.195+0000 7fb0bee6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:31.486 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 131 16 44741 44725 21.3359 16.4375 0.0676976 0.046853 2024-09-22T03:05:32.486 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 132 16 45008 44992 21.3007 16.6875 0.104874 0.046929 2024-09-22T03:05:33.486 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 133 16 45275 45259 21.266 16.6875 0.0630093 0.0470085 2024-09-22T03:05:33.652 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:33.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:33.797+0000 7f753befa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:33.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:33.805+0000 7f753befa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:34.486 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 134 16 45525 45509 21.2239 15.625 0.0523887 0.0470983 2024-09-22T03:05:35.486 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 135 16 45793 45777 21.1908 16.75 0.042265 0.0471746 2024-09-22T03:05:35.587 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:35.587 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:35.587 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:05:35.588 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:05:35.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:35.731+0000 7f823146c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:35.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:35.746+0000 7f823146c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:35.868 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:35.869 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:35.869 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:35.869 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:35.869 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:35.869 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:35.869 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:35.869 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:35.869 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:35.869 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:35.869 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:35.869 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:35.872 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:35.873 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:35.873 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:05:36.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:36.017+0000 7fcda6117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:36.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:36.028+0000 7fcda6117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:36.041 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:36.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:36.186+0000 7ff900c63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:36.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:36.193+0000 7ff900c63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:36.252 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:36.252 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:36.252 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:36.253 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:36.253 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:36.253 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:36.253 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:36.253 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:36.253 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:36.253 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:36.253 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:36.253 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:36.256 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:36.257 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:36.257 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:05:36.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:36.414+0000 7f809beba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:36.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:36.425+0000 7f809beba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:36.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 136 16 46042 46026 21.1494 15.5625 0.0530798 0.0472669 2024-09-22T03:05:36.502 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:36.502 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:36.502 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:36.503 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:36.503 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:36.503 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:36.503 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:36.503 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:36.503 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:36.503 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:36.504 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:36.504 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:36.506 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:36.506 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:36.507 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:05:36.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:36.653+0000 7fe1cc6b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:36.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:36.665+0000 7fe1cc6b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:36.717 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:36.717 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:36.717 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:36.717 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:36.717 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:36.717 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:36.717 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:36.717 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:36.718 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:36.718 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:36.718 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:36.718 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:36.722 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:36.722 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:37.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 137 16 46291 46275 21.1086 15.5625 0.0813608 0.0473587 2024-09-22T03:05:38.380 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:38.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 138 16 46549 46533 21.0725 16.125 0.0477293 0.0474368 2024-09-22T03:05:38.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:38.513+0000 7faeb7157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:38.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:38.521+0000 7faeb7157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:39.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 139 16 46805 46789 21.036 16 0.0420008 0.0475205 2024-09-22T03:05:40.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:2024-09-22T03:05:40.486415+0000 min lat: 0.009172 max lat: 0.376878 avg lat: 0.0475985 2024-09-22T03:05:40.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-09-22T03:05:40.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 140 16 47063 47047 21.0009 16.125 0.0866795 0.0475985 2024-09-22T03:05:40.880 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:41.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:41.017+0000 7fad33197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:41.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:41.025+0000 7fad33197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:41.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 141 16 47312 47296 20.9623 15.5625 0.0364691 0.0476873 2024-09-22T03:05:41.723 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:41.723 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:41.723 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:05:41.723 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:05:41.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:41.867+0000 7f7b6c757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:41.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:41.881+0000 7f7b6c757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:41.906 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:41.906 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:41.906 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:41.906 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:41.906 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:41.907 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:41.907 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:41.907 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:41.907 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:41.907 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:41.907 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:41.907 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:41.911 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:41.911 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:41.911 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:05:42.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:42.061+0000 7fe10a818640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:42.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:42.076+0000 7fe10a818640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:42.135 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:42.135 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:42.135 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:42.135 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:42.135 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:42.135 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:42.135 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:42.136 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:42.136 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:42.136 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:42.136 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:42.136 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:42.138 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:42.138 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:42.138 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:05:42.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:42.282+0000 7f9625b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:42.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:42.297+0000 7f9625b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:42.322 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:42.322 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:42.322 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:42.323 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:42.323 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:42.323 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:42.323 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:42.323 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:42.323 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:42.324 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:42.324 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:42.324 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:42.327 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:42.328 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:42.328 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:05:42.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:42.470+0000 7ffbf6957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:42.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:42.484+0000 7ffbf6957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:42.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 142 16 47564 47548 20.9256 15.75 0.0608537 0.0477726 2024-09-22T03:05:42.559 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:42.559 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:42.559 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:42.559 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:42.559 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:42.559 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:42.560 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:42.560 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:42.560 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:42.560 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:42.560 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:42.560 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:42.565 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:42.565 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:43.447 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:43.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 143 16 47825 47809 20.8933 16.3125 0.0547187 0.0478456 2024-09-22T03:05:43.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:43.589+0000 7f29a864f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:43.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:43.599+0000 7f29a864f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:44.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 144 16 48069 48053 20.8541 15.25 0.0660509 0.047932 2024-09-22T03:05:45.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 145 16 48329 48313 20.8224 16.25 0.0605408 0.0480104 2024-09-22T03:05:45.936 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:46.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:46.073+0000 7f2352858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:46.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:46.081+0000 7f2352858640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:46.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 146 16 48575 48559 20.785 15.375 0.0474368 0.0480932 2024-09-22T03:05:47.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 147 16 48832 48816 20.7529 16.0625 0.0661859 0.0481704 2024-09-22T03:05:47.566 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:47.566 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:47.567 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:05:47.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:47.709+0000 7fc555b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:47.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:47.719+0000 7fc555b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:48.032 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:05:48.032 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:05:48.056 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-09-22T03:05:47.335298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3173777971,"num_objects":48423,"num_object_clones":0,"num_object_copies":145269,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":48558,"num_write_kb":3100712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48503,"ondisk_log_size":48503,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":848112,"kb_used_data":579760,"kb_used_omap":0,"kb_used_meta":268288,"kb_avail":376639248,"statfs":{"total":386547056640,"available":385678589952,"internally_reserved":0,"allocated":593674240,"data_stored":9484315001,"data_compressed":450355600,"data_compressed_allocated":592764928,"data_compressed_original":9483993088,"omap_allocated":0,"internal_metadata":274726912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":230227968,"num_objects":3513,"num_object_clones":0,"num_object_copies":10539,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3513,"num_write_kb":224832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002276"},"pg_stats":[{"pgid":"3.f","version":"25'3000","reported_seq":3037,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:44.258358+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:05:44.258358+0000","last_peered":"2024-09-22T03:05:44.258358+0000","last_clean":"2024-09-22T03:05:44.258358+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:05:44.258358+0000","last_undegraded":"2024-09-22T03:05:44.258358+0000","last_fullsized":"2024-09-22T03:05:44.258358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3000,"log_dups_size":0,"ondisk_log_size":3000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196673536,"num_objects":3001,"num_object_clones":0,"num_object_copies":9003,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3001,"num_write_kb":192064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'3072","reported_seq":3109,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:46.114724+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:05:46.114724+0000","last_peered":"2024-09-22T03:05:46.114724+0000","last_clean":"2024-09-22T03:05:46.114724+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:05:46.114724+0000","last_undegraded":"2024-09-22T03:05:46.114724+0000","last_fullsized":"2024-09-22T03:05:46.114724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3072,"log_dups_size":0,"ondisk_log_size":3072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201392128,"num_objects":3073,"num_object_clones":0,"num_object_copies":9219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3073,"num_write_kb":196672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'2962","reported_seq":2999,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:46.264833+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:05:46.264833+0000","last_peered":"2024-09-22T03:05:46.264833+0000","last_clean":"2024-09-22T03:05:46.264833+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:05:46.264833+0000","last_undegraded":"2024-09-22T03:05:46.264833+0000","last_fullsized":"2024-09-22T03:05:46.264833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2962,"log_dups_size":0,"ondisk_log_size":2962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194183168,"num_objects":2963,"num_object_clones":0,"num_object_copies":8889,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2963,"num_write_kb":189632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'3020","reported_seq":3057,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:44.165908+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:05:44.165908+0000","last_peered":"2024-09-22T03:05:44.165908+0000","last_clean":"2024-09-22T03:05:44.165908+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:05:44.165908+0000","last_undegraded":"2024-09-22T03:05:44.165908+0000","last_fullsized":"2024-09-22T03:05:44.165908+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3020,"log_dups_size":0,"ondisk_log_size":3020,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197984256,"num_objects":3021,"num_object_clones":0,"num_object_copies":9063,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3021,"num_write_kb":193344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'2993","reported_seq":3030,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:46.320732+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:05:46.320732+0000","last_peered":"2024-09-22T03:05:46.320732+0000","last_clean":"2024-09-22T03:05:46.320732+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:05:46.320732+0000","last_undegraded":"2024-09-22T03:05:46.320732+0000","last_fullsized":"2024-09-22T03:05:46.320732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2993,"log_dups_size":0,"ondisk_log_size":2993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196214784,"num_objects":2994,"num_object_clones":0,"num_object_copies":8982,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2994,"num_write_kb":191616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'3054","reported_seq":3091,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:44.194282+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:05:44.194282+0000","last_peered":"2024-09-22T03:05:44.194282+0000","last_clean":"2024-09-22T03:05:44.194282+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:05:44.194282+0000","last_undegraded":"2024-09-22T03:05:44.194282+0000","last_fullsized":"2024-09-22T03:05:44.194282+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3054,"log_dups_size":0,"ondisk_log_size":3054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200212480,"num_objects":3055,"num_object_clones":0,"num_object_copies":9165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3055,"num_write_kb":195520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'3083","reported_seq":3120,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:44.046429+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:05:44.046429+0000","last_peered":"2024-09-22T03:05:44.046429+0000","last_clean":"2024-09-22T03:05:44.046429+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:05:44.046429+0000","last_undegraded":"2024-09-22T03:05:44.046429+0000","last_fullsized":"2024-09-22T03:05:44.046429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3083,"log_dups_size":0,"ondisk_log_size":3083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202113024,"num_objects":3084,"num_object_clones":0,"num_object_copies":9252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3084,"num_write_kb":197376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'3023","reported_seq":3060,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:46.196656+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:05:46.196656+0000","last_peered":"2024-09-22T03:05:46.196656+0000","last_clean":"2024-09-22T03:05:46.196656+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:05:46.196656+0000","last_undegraded":"2024-09-22T03:05:46.196656+0000","last_fullsized":"2024-09-22T03:05:46.196656+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3023,"log_dups_size":0,"ondisk_log_size":3023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198180864,"num_objects":3024,"num_object_clones":0,"num_object_copies":9072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3024,"num_write_kb":193536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'3059","reported_seq":3096,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:46.272178+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:05:46.272178+0000","last_peered":"2024-09-22T03:05:46.272178+0000","last_clean":"2024-09-22T03:05:46.272178+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:05:46.272178+0000","last_undegraded":"2024-09-22T03:05:46.272178+0000","last_fullsized":"2024-09-22T03:05:46.272178+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3059,"log_dups_size":0,"ondisk_log_size":3059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200540160,"num_objects":3060,"num_object_clones":0,"num_object_copies":9180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3060,"num_write_kb":195840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'2973","reported_seq":3010,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:46.149515+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:05:46.149515+0000","last_peered":"2024-09-22T03:05:46.149515+0000","last_clean":"2024-09-22T03:05:46.149515+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:05:46.149515+0000","last_undegraded":"2024-09-22T03:05:46.149515+0000","last_fullsized":"2024-09-22T03:05:46.149515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2973,"log_dups_size":0,"ondisk_log_size":2973,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194904064,"num_objects":2974,"num_object_clones":0,"num_object_copies":8922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2974,"num_write_kb":190336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'3023","reported_seq":3060,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:46.297577+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:05:46.297577+0000","last_peered":"2024-09-22T03:05:46.297577+0000","last_clean":"2024-09-22T03:05:46.297577+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:05:46.297577+0000","last_undegraded":"2024-09-22T03:05:46.297577+0000","last_fullsized":"2024-09-22T03:05:46.297577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3023,"log_dups_size":0,"ondisk_log_size":3023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198180864,"num_objects":3024,"num_object_clones":0,"num_object_copies":9072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3024,"num_write_kb":193536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'3049","reported_seq":3086,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:46.321010+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:05:46.321010+0000","last_peered":"2024-09-22T03:05:46.321010+0000","last_clean":"2024-09-22T03:05:46.321010+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:05:46.321010+0000","last_undegraded":"2024-09-22T03:05:46.321010+0000","last_fullsized":"2024-09-22T03:05:46.321010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3049,"log_dups_size":0,"ondisk_log_size":3049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199884800,"num_objects":3050,"num_object_clones":0,"num_object_copies":9150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3050,"num_write_kb":195200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'2964","reported_seq":3001,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:46.283517+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:05:46.283517+0000","last_peered":"2024-09-22T03:05:46.283517+0000","last_clean":"2024-09-22T03:05:46.283517+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:05:46.283517+0000","last_undegraded":"2024-09-22T03:05:46.283517+0000","last_fullsized":"2024-09-22T03:05:46.283517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":2964,"log_dups_size":0,"ondisk_log_size":2964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194314240,"num_objects":2965,"num_object_clones":0,"num_object_copies":8895,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2965,"num_write_kb":189760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'3053","reported_seq":3090,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:46.180818+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:05:46.180818+0000","last_peered":"2024-09-22T03:05:46.180818+0000","last_clean":"2024-09-22T03:05:46.180818+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:05:46.180818+0000","last_undegraded":"2024-09-22T03:05:46.180818+0000","last_fullsized":"2024-09-22T03:05:46.180818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3053,"log_dups_size":0,"ondisk_log_size":3053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200146944,"num_objects":3054,"num_object_clones":0,"num_object_copies":9162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3054,"num_write_kb":195456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'3025","reported_seq":3062,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:46.130410+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:05:46.130410+0000","last_peered":"2024-09-22T03:05:46.130410+0000","last_clean":"2024-09-22T03:05:46.130410+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:05:46.130410+0000","last_undegraded":"2024-09-22T03:05:46.130410+0000","last_fullsized":"2024-09-22T03:05:46.130410+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3025,"log_dups_size":0,"ondisk_log_size":3025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198311936,"num_objects":3026,"num_object_clones":0,"num_object_copies":9078,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3026,"num_write_kb":193664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'3050","reported_seq":3087,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:46.341797+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:05:46.341797+0000","last_peered":"2024-09-22T03:05:46.341797+0000","last_clean":"2024-09-22T03:05:46.341797+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:05:46.341797+0000","last_undegraded":"2024-09-22T03:05:46.341797+0000","last_fullsized":"2024-09-22T03:05:46.341797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3050,"log_dups_size":0,"ondisk_log_size":3050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199950336,"num_objects":3051,"num_object_clones":0,"num_object_copies":9153,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3051,"num_write_kb":195264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":3173187584,"num_objects":48419,"num_object_clones":0,"num_object_copies":145257,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48419,"num_write_kb":3098816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":595120128,"data_stored":9521922048,"data_compressed":452148474,"data_compressed_allocated":595120128,"data_compressed_original":9521922048,"omap_allocated":0,"internal_metadata":0},"log_size":48403,"ondisk_log_size":48403,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673120,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":235988,"kb_used_data":168900,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94135852,"statfs":{"total":96636764160,"available":96395112448,"internally_reserved":0,"allocated":172953600,"data_stored":2763917515,"data_compressed":131241411,"data_compressed_allocated":172740608,"data_compressed_original":2763849728,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673120,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":204452,"kb_used_data":133204,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94167388,"statfs":{"total":96636764160,"available":96427405312,"internally_reserved":0,"allocated":136400896,"data_stored":2178681579,"data_compressed":103453415,"data_compressed_allocated":136167424,"data_compressed_original":2178596864,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673120,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":208612,"kb_used_data":145684,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94163228,"statfs":{"total":96636764160,"available":96423145472,"internally_reserved":0,"allocated":149180416,"data_stored":2383153899,"data_compressed":113162762,"data_compressed_allocated":148946944,"data_compressed_original":2383069184,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705823,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":199060,"kb_used_data":131972,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94172780,"statfs":{"total":96636764160,"available":96432926720,"internally_reserved":0,"allocated":135139328,"data_stored":2158562008,"data_compressed":102498012,"data_compressed_allocated":134909952,"data_compressed_original":2158477312,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":135454720,"data_stored":2167275520,"data_compressed":102913066,"data_compressed_allocated":135454720,"data_compressed_original":2167275520,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":149524480,"data_stored":2392391680,"data_compressed":113602712,"data_compressed_allocated":149524480,"data_compressed_original":2392391680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":136724480,"data_stored":2187591680,"data_compressed":103877805,"data_compressed_allocated":136724480,"data_compressed_original":2187591680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":173416448,"data_stored":2774663168,"data_compressed":131754891,"data_compressed_allocated":173416448,"data_compressed_original":2774663168,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:05:48.410 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:48.488 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 148 16 49079 49063 20.717 15.4375 0.0430917 0.0482549 2024-09-22T03:05:48.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:48.566+0000 7f5449e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:48.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:48.575+0000 7f5449e4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:49.487 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 149 16 49325 49309 20.6811 15.375 0.0396255 0.0483329 2024-09-22T03:05:50.488 INFO:tasks.radosbench.radosbench.0.smithi145.stdout: 150 8 49569 49561 20.6482 15.75 0.0558419 0.0484169 2024-09-22T03:05:50.862 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:50.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:50.961+0000 7fbafe197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:50.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:50.965+0000 7fbafe197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:51.490 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Total time run: 150.029 2024-09-22T03:05:51.490 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Total writes made: 49569 2024-09-22T03:05:51.490 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Write size: 65536 2024-09-22T03:05:51.490 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Object size: 65536 2024-09-22T03:05:51.490 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Bandwidth (MB/sec): 20.6498 2024-09-22T03:05:51.490 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Stddev Bandwidth: 4.13235 2024-09-22T03:05:51.490 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Max bandwidth (MB/sec): 29.875 2024-09-22T03:05:51.490 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Min bandwidth (MB/sec): 11.875 2024-09-22T03:05:51.490 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Average IOPS: 330 2024-09-22T03:05:51.490 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Stddev IOPS: 66.1177 2024-09-22T03:05:51.490 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Max IOPS: 478 2024-09-22T03:05:51.490 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Min IOPS: 190 2024-09-22T03:05:51.491 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Average Latency(s): 0.0484166 2024-09-22T03:05:51.491 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Stddev Latency(s): 0.0183734 2024-09-22T03:05:51.491 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Max latency(s): 0.376878 2024-09-22T03:05:51.491 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Min latency(s): 0.009172 2024-09-22T03:05:51.512 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Cleaning up (deleting benchmark objects) 2024-09-22T03:05:53.035 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:53.058 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:53.059 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:53.059 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:05:53.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:53.177+0000 7fc128797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:53.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:53.185+0000 7fc128797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:53.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:53.224+0000 7f415a2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:53.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:53.236+0000 7f415a2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:53.581 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:05:53.581 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:05:53.603 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-22T03:05:53.336400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3245015603,"num_objects":49510,"num_object_clones":0,"num_object_copies":148530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":49645,"num_write_kb":3170280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49590,"ondisk_log_size":49590,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":879540,"kb_used_data":594544,"kb_used_omap":0,"kb_used_meta":284928,"kb_avail":376607820,"statfs":{"total":386547056640,"available":385646407680,"internally_reserved":0,"allocated":608813056,"data_stored":9726536057,"data_compressed":461857552,"data_compressed_allocated":607903744,"data_compressed_original":9726214144,"omap_allocated":0,"internal_metadata":291766272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216858624,"num_objects":3309,"num_object_clones":0,"num_object_copies":9927,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3309,"num_write_kb":211776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002217"},"pg_stats":[{"pgid":"3.f","version":"25'3079","reported_seq":3116,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:49.280801+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:05:49.280801+0000","last_peered":"2024-09-22T03:05:49.280801+0000","last_clean":"2024-09-22T03:05:49.280801+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:05:49.280801+0000","last_undegraded":"2024-09-22T03:05:49.280801+0000","last_fullsized":"2024-09-22T03:05:49.280801+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3079,"log_dups_size":0,"ondisk_log_size":3079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201850880,"num_objects":3080,"num_object_clones":0,"num_object_copies":9240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3080,"num_write_kb":197120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'3147","reported_seq":3184,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:50.336072+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:05:50.336072+0000","last_peered":"2024-09-22T03:05:50.336072+0000","last_clean":"2024-09-22T03:05:50.336072+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:05:50.336072+0000","last_undegraded":"2024-09-22T03:05:50.336072+0000","last_fullsized":"2024-09-22T03:05:50.336072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3147,"log_dups_size":0,"ondisk_log_size":3147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206307328,"num_objects":3148,"num_object_clones":0,"num_object_copies":9444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3148,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'3026","reported_seq":3063,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:50.205413+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:05:50.205413+0000","last_peered":"2024-09-22T03:05:50.205413+0000","last_clean":"2024-09-22T03:05:50.205413+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:05:50.205413+0000","last_undegraded":"2024-09-22T03:05:50.205413+0000","last_fullsized":"2024-09-22T03:05:50.205413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3026,"log_dups_size":0,"ondisk_log_size":3026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198377472,"num_objects":3027,"num_object_clones":0,"num_object_copies":9081,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3027,"num_write_kb":193728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'3088","reported_seq":3125,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:49.146852+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:05:49.146852+0000","last_peered":"2024-09-22T03:05:49.146852+0000","last_clean":"2024-09-22T03:05:49.146852+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:05:49.146852+0000","last_undegraded":"2024-09-22T03:05:49.146852+0000","last_fullsized":"2024-09-22T03:05:49.146852+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3088,"log_dups_size":0,"ondisk_log_size":3088,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202440704,"num_objects":3089,"num_object_clones":0,"num_object_copies":9267,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3089,"num_write_kb":197696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'3058","reported_seq":3095,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:50.232543+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:05:50.232543+0000","last_peered":"2024-09-22T03:05:50.232543+0000","last_clean":"2024-09-22T03:05:50.232543+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:05:50.232543+0000","last_undegraded":"2024-09-22T03:05:50.232543+0000","last_fullsized":"2024-09-22T03:05:50.232543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3058,"log_dups_size":0,"ondisk_log_size":3058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200474624,"num_objects":3059,"num_object_clones":0,"num_object_copies":9177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3059,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'3137","reported_seq":3174,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:49.295900+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:05:49.295900+0000","last_peered":"2024-09-22T03:05:49.295900+0000","last_clean":"2024-09-22T03:05:49.295900+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:05:49.295900+0000","last_undegraded":"2024-09-22T03:05:49.295900+0000","last_fullsized":"2024-09-22T03:05:49.295900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3137,"log_dups_size":0,"ondisk_log_size":3137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205651968,"num_objects":3138,"num_object_clones":0,"num_object_copies":9414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3138,"num_write_kb":200832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'3154","reported_seq":3191,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:49.295399+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:05:49.295399+0000","last_peered":"2024-09-22T03:05:49.295399+0000","last_clean":"2024-09-22T03:05:49.295399+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:05:49.295399+0000","last_undegraded":"2024-09-22T03:05:49.295399+0000","last_fullsized":"2024-09-22T03:05:49.295399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3154,"log_dups_size":0,"ondisk_log_size":3154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206766080,"num_objects":3155,"num_object_clones":0,"num_object_copies":9465,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3155,"num_write_kb":201920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'3093","reported_seq":3130,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:50.300515+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:05:50.300515+0000","last_peered":"2024-09-22T03:05:50.300515+0000","last_clean":"2024-09-22T03:05:50.300515+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:05:50.300515+0000","last_undegraded":"2024-09-22T03:05:50.300515+0000","last_fullsized":"2024-09-22T03:05:50.300515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3093,"log_dups_size":0,"ondisk_log_size":3093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202768384,"num_objects":3094,"num_object_clones":0,"num_object_copies":9282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3094,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'3127","reported_seq":3164,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:50.358340+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:05:50.358340+0000","last_peered":"2024-09-22T03:05:50.358340+0000","last_clean":"2024-09-22T03:05:50.358340+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:05:50.358340+0000","last_undegraded":"2024-09-22T03:05:50.358340+0000","last_fullsized":"2024-09-22T03:05:50.358340+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3127,"log_dups_size":0,"ondisk_log_size":3127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204996608,"num_objects":3128,"num_object_clones":0,"num_object_copies":9384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3128,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'3052","reported_seq":3089,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:50.426212+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:05:50.426212+0000","last_peered":"2024-09-22T03:05:50.426212+0000","last_clean":"2024-09-22T03:05:50.426212+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:05:50.426212+0000","last_undegraded":"2024-09-22T03:05:50.426212+0000","last_fullsized":"2024-09-22T03:05:50.426212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3052,"log_dups_size":0,"ondisk_log_size":3052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200081408,"num_objects":3053,"num_object_clones":0,"num_object_copies":9159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3053,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'3081","reported_seq":3118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:50.402255+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:05:50.402255+0000","last_peered":"2024-09-22T03:05:50.402255+0000","last_clean":"2024-09-22T03:05:50.402255+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:05:50.402255+0000","last_undegraded":"2024-09-22T03:05:50.402255+0000","last_fullsized":"2024-09-22T03:05:50.402255+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3081,"log_dups_size":0,"ondisk_log_size":3081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201981952,"num_objects":3082,"num_object_clones":0,"num_object_copies":9246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3082,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'3104","reported_seq":3141,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:50.470658+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:05:50.470658+0000","last_peered":"2024-09-22T03:05:50.470658+0000","last_clean":"2024-09-22T03:05:50.470658+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:05:50.470658+0000","last_undegraded":"2024-09-22T03:05:50.470658+0000","last_fullsized":"2024-09-22T03:05:50.470658+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3104,"log_dups_size":0,"ondisk_log_size":3104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203489280,"num_objects":3105,"num_object_clones":0,"num_object_copies":9315,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3105,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'3029","reported_seq":3066,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:50.225094+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:05:50.225094+0000","last_peered":"2024-09-22T03:05:50.225094+0000","last_clean":"2024-09-22T03:05:50.225094+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:05:50.225094+0000","last_undegraded":"2024-09-22T03:05:50.225094+0000","last_fullsized":"2024-09-22T03:05:50.225094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3029,"log_dups_size":0,"ondisk_log_size":3029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198574080,"num_objects":3030,"num_object_clones":0,"num_object_copies":9090,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3030,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'3120","reported_seq":3157,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:50.402795+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:05:50.402795+0000","last_peered":"2024-09-22T03:05:50.402795+0000","last_clean":"2024-09-22T03:05:50.402795+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:05:50.402795+0000","last_undegraded":"2024-09-22T03:05:50.402795+0000","last_fullsized":"2024-09-22T03:05:50.402795+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3120,"log_dups_size":0,"ondisk_log_size":3120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204537856,"num_objects":3121,"num_object_clones":0,"num_object_copies":9363,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3121,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'3081","reported_seq":3118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:50.362546+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:05:50.362546+0000","last_peered":"2024-09-22T03:05:50.362546+0000","last_clean":"2024-09-22T03:05:50.362546+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:05:50.362546+0000","last_undegraded":"2024-09-22T03:05:50.362546+0000","last_fullsized":"2024-09-22T03:05:50.362546+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3081,"log_dups_size":0,"ondisk_log_size":3081,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201981952,"num_objects":3082,"num_object_clones":0,"num_object_copies":9246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3082,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'3114","reported_seq":3151,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:50.381219+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:05:50.381219+0000","last_peered":"2024-09-22T03:05:50.381219+0000","last_clean":"2024-09-22T03:05:50.381219+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:05:50.381219+0000","last_undegraded":"2024-09-22T03:05:50.381219+0000","last_fullsized":"2024-09-22T03:05:50.381219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3114,"log_dups_size":0,"ondisk_log_size":3114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204144640,"num_objects":3115,"num_object_clones":0,"num_object_copies":9345,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3115,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":3244425216,"num_objects":49506,"num_object_clones":0,"num_object_copies":148518,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49506,"num_write_kb":3168384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":608346112,"data_stored":9733537792,"data_compressed":462197122,"data_compressed_allocated":608346112,"data_compressed_original":9733537792,"omap_allocated":0,"internal_metadata":0},"log_size":49490,"ondisk_log_size":49490,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673125,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":244412,"kb_used_data":173164,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94127428,"statfs":{"total":96636764160,"available":96386486272,"internally_reserved":0,"allocated":177319936,"data_stored":2833778891,"data_compressed":134558803,"data_compressed_allocated":177106944,"data_compressed_original":2833711104,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673125,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":212080,"kb_used_data":136672,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94159760,"statfs":{"total":96636764160,"available":96419594240,"internally_reserved":0,"allocated":139952128,"data_stored":2235501291,"data_compressed":106151519,"data_compressed_allocated":139718656,"data_compressed_original":2235416576,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673125,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":216424,"kb_used_data":149336,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94155416,"statfs":{"total":96636764160,"available":96415145984,"internally_reserved":0,"allocated":152920064,"data_stored":2442988267,"data_compressed":116004018,"data_compressed_allocated":152686592,"data_compressed_original":2442903552,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705828,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":206624,"kb_used_data":135372,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94165216,"statfs":{"total":96636764160,"available":96425181184,"internally_reserved":0,"allocated":138620928,"data_stored":2214267608,"data_compressed":105143212,"data_compressed_allocated":138391552,"data_compressed_original":2214182912,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":138915840,"data_stored":2222653440,"data_compressed":105542706,"data_compressed_allocated":138915840,"data_compressed_original":2222653440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":152645632,"data_stored":2442330112,"data_compressed":115974056,"data_compressed_allocated":152645632,"data_compressed_original":2442330112,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139677696,"data_stored":2234843136,"data_compressed":106121557,"data_compressed_allocated":139677696,"data_compressed_original":2234843136,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":177106944,"data_stored":2833711104,"data_compressed":134558803,"data_compressed_allocated":177106944,"data_compressed_original":2833711104,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:05:55.524 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:05:55.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:55.675+0000 7f172d8b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:55.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:55.681+0000 7f172d8b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:57.891 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:05:58.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:58.041+0000 7fc0ff397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:58.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:58.049+0000 7fc0ff397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:58.604 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:05:58.605 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:05:58.605 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:05:58.605 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:05:58.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:58.748+0000 7ff914263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:58.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:58.762+0000 7ff914263640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:58.837 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:58.837 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:58.837 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:58.837 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:58.837 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:58.837 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:58.837 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:58.837 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:58.837 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:58.837 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:58.838 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:58.838 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:58.840 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:58.841 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:58.841 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:05:58.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:58.982+0000 7f81f2b0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:58.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:58.992+0000 7f81f2b0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:59.012 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:59.012 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:59.012 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:59.013 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:59.013 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:59.013 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:59.013 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:59.013 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:59.013 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:59.013 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:59.013 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:59.013 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:59.016 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:59.016 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:59.016 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:05:59.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:59.153+0000 7fef5ac6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:59.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:59.166+0000 7fef5ac6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:59.225 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:59.225 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:59.225 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:59.225 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:59.225 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:59.225 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:59.225 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:59.226 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:59.226 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:59.226 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:59.226 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:59.226 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:59.229 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:59.230 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:05:59.230 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:05:59.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:59.364+0000 7f7e4d66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:59.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:05:59.379+0000 7f7e4d66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:05:59.399 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:05:59.399 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:05:59.399 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:05:59.400 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:05:59.400 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:05:59.400 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:05:59.400 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:05:59.400 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:05:59.400 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:05:59.400 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:05:59.400 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:05:59.400 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:05:59.403 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:05:59.403 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:00.243 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:00.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:00.386+0000 7f220e22c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:00.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:00.396+0000 7f220e22c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:02.599 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:02.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:02.739+0000 7f7f822d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:02.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:02.746+0000 7f7f822d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:04.404 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:04.404 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:04.405 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:04.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:04.558+0000 7ff0b1717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:04.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:04.570+0000 7ff0b1717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:04.878 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:06:04.879 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:06:04.898 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-09-22T03:06:03.338150+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3088908875,"num_objects":47129,"num_object_clones":0,"num_object_copies":141387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":52154,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":52099,"ondisk_log_size":52099,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":870564,"kb_used_data":568928,"kb_used_omap":0,"kb_used_meta":301568,"kb_avail":376616796,"statfs":{"total":386547056640,"available":385655599104,"internally_reserved":0,"allocated":582582272,"data_stored":9306646977,"data_compressed":441922298,"data_compressed_allocated":581660672,"data_compressed_original":9306324992,"omap_allocated":0,"internal_metadata":308805632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-104595432,"num_objects":-1595,"num_object_clones":0,"num_object_copies":-4785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3295,"num_write_kb":54337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002087"},"pg_stats":[{"pgid":"3.f","version":"25'3221","reported_seq":3258,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:59.226680+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:05:59.226680+0000","last_peered":"2024-09-22T03:05:59.226680+0000","last_clean":"2024-09-22T03:05:59.226680+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:05:59.226680+0000","last_undegraded":"2024-09-22T03:05:59.226680+0000","last_fullsized":"2024-09-22T03:05:59.226680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3221,"log_dups_size":0,"ondisk_log_size":3221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193462272,"num_objects":2952,"num_object_clones":0,"num_object_copies":8856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3222,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'3304","reported_seq":3341,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:01.224748+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:06:01.224748+0000","last_peered":"2024-09-22T03:06:01.224748+0000","last_clean":"2024-09-22T03:06:01.224748+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:06:01.224748+0000","last_undegraded":"2024-09-22T03:06:01.224748+0000","last_fullsized":"2024-09-22T03:06:01.224748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3304,"log_dups_size":0,"ondisk_log_size":3304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":196018176,"num_objects":2991,"num_object_clones":0,"num_object_copies":8973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3305,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'3190","reported_seq":3228,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:01.280590+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:06:01.280590+0000","last_peered":"2024-09-22T03:06:01.280590+0000","last_clean":"2024-09-22T03:06:01.280590+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:06:01.280590+0000","last_undegraded":"2024-09-22T03:06:01.280590+0000","last_fullsized":"2024-09-22T03:06:01.280590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3190,"log_dups_size":0,"ondisk_log_size":3190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187695128,"num_objects":2865,"num_object_clones":0,"num_object_copies":8595,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3191,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'3230","reported_seq":3267,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:59.333958+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:05:59.333958+0000","last_peered":"2024-09-22T03:05:59.333958+0000","last_clean":"2024-09-22T03:05:59.333958+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:05:59.333958+0000","last_undegraded":"2024-09-22T03:05:59.333958+0000","last_fullsized":"2024-09-22T03:05:59.333958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3230,"log_dups_size":0,"ondisk_log_size":3230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":195624960,"num_objects":2985,"num_object_clones":0,"num_object_copies":8955,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3231,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'3225","reported_seq":3262,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:01.356175+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:06:01.356175+0000","last_peered":"2024-09-22T03:06:01.356175+0000","last_clean":"2024-09-22T03:06:01.356175+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:06:01.356175+0000","last_undegraded":"2024-09-22T03:06:01.356175+0000","last_fullsized":"2024-09-22T03:06:01.356175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3225,"log_dups_size":0,"ondisk_log_size":3225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189530112,"num_objects":2892,"num_object_clones":0,"num_object_copies":8676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3226,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'3297","reported_seq":3334,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:59.296593+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:05:59.296593+0000","last_peered":"2024-09-22T03:05:59.296593+0000","last_clean":"2024-09-22T03:05:59.296593+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:05:59.296593+0000","last_undegraded":"2024-09-22T03:05:59.296593+0000","last_fullsized":"2024-09-22T03:05:59.296593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3297,"log_dups_size":0,"ondisk_log_size":3297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197263360,"num_objects":3010,"num_object_clones":0,"num_object_copies":9030,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3298,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'3302","reported_seq":3339,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:05:59.304088+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:05:59.304088+0000","last_peered":"2024-09-22T03:05:59.304088+0000","last_clean":"2024-09-22T03:05:59.304088+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:05:59.304088+0000","last_undegraded":"2024-09-22T03:05:59.304088+0000","last_fullsized":"2024-09-22T03:05:59.304088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3302,"log_dups_size":0,"ondisk_log_size":3302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199819264,"num_objects":3049,"num_object_clones":0,"num_object_copies":9147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3303,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'3255","reported_seq":3292,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:01.230598+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:06:01.230598+0000","last_peered":"2024-09-22T03:06:01.230598+0000","last_clean":"2024-09-22T03:06:01.230598+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:06:01.230598+0000","last_undegraded":"2024-09-22T03:06:01.230598+0000","last_fullsized":"2024-09-22T03:06:01.230598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3255,"log_dups_size":0,"ondisk_log_size":3255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192151552,"num_objects":2932,"num_object_clones":0,"num_object_copies":8796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3256,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'3303","reported_seq":3340,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:01.295976+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:06:01.295976+0000","last_peered":"2024-09-22T03:06:01.295976+0000","last_clean":"2024-09-22T03:06:01.295976+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:06:01.295976+0000","last_undegraded":"2024-09-22T03:06:01.295976+0000","last_fullsized":"2024-09-22T03:06:01.295976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3303,"log_dups_size":0,"ondisk_log_size":3303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193462272,"num_objects":2952,"num_object_clones":0,"num_object_copies":8856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3304,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'3177","reported_seq":3214,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:01.329439+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:06:01.329439+0000","last_peered":"2024-09-22T03:06:01.329439+0000","last_clean":"2024-09-22T03:06:01.329439+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:06:01.329439+0000","last_undegraded":"2024-09-22T03:06:01.329439+0000","last_fullsized":"2024-09-22T03:06:01.329439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3177,"log_dups_size":0,"ondisk_log_size":3177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191889408,"num_objects":2928,"num_object_clones":0,"num_object_copies":8784,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3178,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'3257","reported_seq":3294,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:01.289079+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:06:01.289079+0000","last_peered":"2024-09-22T03:06:01.289079+0000","last_clean":"2024-09-22T03:06:01.289079+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:06:01.289079+0000","last_undegraded":"2024-09-22T03:06:01.289079+0000","last_fullsized":"2024-09-22T03:06:01.289079+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3257,"log_dups_size":0,"ondisk_log_size":3257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190447616,"num_objects":2906,"num_object_clones":0,"num_object_copies":8718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3258,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'3270","reported_seq":3307,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:01.310755+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:06:01.310755+0000","last_peered":"2024-09-22T03:06:01.310755+0000","last_clean":"2024-09-22T03:06:01.310755+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:06:01.310755+0000","last_undegraded":"2024-09-22T03:06:01.310755+0000","last_fullsized":"2024-09-22T03:06:01.310755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3270,"log_dups_size":0,"ondisk_log_size":3270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192610304,"num_objects":2939,"num_object_clones":0,"num_object_copies":8817,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3271,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'3167","reported_seq":3204,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:01.145788+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:06:01.145788+0000","last_peered":"2024-09-22T03:06:01.145788+0000","last_clean":"2024-09-22T03:06:01.145788+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:06:01.145788+0000","last_undegraded":"2024-09-22T03:06:01.145788+0000","last_fullsized":"2024-09-22T03:06:01.145788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3167,"log_dups_size":0,"ondisk_log_size":3167,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":189530112,"num_objects":2892,"num_object_clones":0,"num_object_copies":8676,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3168,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'3293","reported_seq":3330,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:01.214488+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:06:01.214488+0000","last_peered":"2024-09-22T03:06:01.214488+0000","last_clean":"2024-09-22T03:06:01.214488+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:06:01.214488+0000","last_undegraded":"2024-09-22T03:06:01.214488+0000","last_fullsized":"2024-09-22T03:06:01.214488+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3293,"log_dups_size":0,"ondisk_log_size":3293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193200128,"num_objects":2948,"num_object_clones":0,"num_object_copies":8844,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3294,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'3238","reported_seq":3275,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:01.206027+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:06:01.206027+0000","last_peered":"2024-09-22T03:06:01.206027+0000","last_clean":"2024-09-22T03:06:01.206027+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:06:01.206027+0000","last_undegraded":"2024-09-22T03:06:01.206027+0000","last_fullsized":"2024-09-22T03:06:01.206027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3238,"log_dups_size":0,"ondisk_log_size":3238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191692800,"num_objects":2925,"num_object_clones":0,"num_object_copies":8775,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3239,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'3270","reported_seq":3307,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:01.224316+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:06:01.224316+0000","last_peered":"2024-09-22T03:06:01.224316+0000","last_clean":"2024-09-22T03:06:01.224316+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:06:01.224316+0000","last_undegraded":"2024-09-22T03:06:01.224316+0000","last_fullsized":"2024-09-22T03:06:01.224316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3270,"log_dups_size":0,"ondisk_log_size":3270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":193921024,"num_objects":2959,"num_object_clones":0,"num_object_copies":8877,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3271,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":3088318488,"num_objects":47125,"num_object_clones":0,"num_object_copies":141375,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":52015,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":579022848,"data_stored":9264169032,"data_compressed":439912308,"data_compressed_allocated":579010560,"data_compressed_original":9264168960,"omap_allocated":0,"internal_metadata":0},"log_size":51999,"ondisk_log_size":51999,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673135,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":244488,"kb_used_data":164916,"kb_used_omap":0,"kb_used_meta":79552,"kb_avail":94127352,"statfs":{"total":96636764160,"available":96386408448,"internally_reserved":0,"allocated":168873984,"data_stored":2698578147,"data_compressed":128139709,"data_compressed_allocated":168656896,"data_compressed_original":2698510336,"omap_allocated":0,"internal_metadata":81461248},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673135,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":197472,"kb_used_data":130384,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94174368,"statfs":{"total":96636764160,"available":96434552832,"internally_reserved":0,"allocated":133513216,"data_stored":2132478699,"data_compressed":101260209,"data_compressed_allocated":133279744,"data_compressed_original":2132393984,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673135,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":217516,"kb_used_data":142108,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94154324,"statfs":{"total":96636764160,"available":96414027776,"internally_reserved":0,"allocated":145518592,"data_stored":2324499203,"data_compressed":110378366,"data_compressed_allocated":145281024,"data_compressed_original":2324414464,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705838,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":211088,"kb_used_data":131520,"kb_used_omap":0,"kb_used_meta":79552,"kb_avail":94160752,"statfs":{"total":96636764160,"available":96420610048,"internally_reserved":0,"allocated":134676480,"data_stored":2151090928,"data_compressed":102144014,"data_compressed_allocated":134443008,"data_compressed_original":2151006208,"omap_allocated":0,"internal_metadata":81461248},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":133844992,"data_stored":2141454360,"data_compressed":101687708,"data_compressed_allocated":133840896,"data_compressed_original":2141454336,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":144564224,"data_stored":2312962072,"data_compressed":109831812,"data_compressed_allocated":144560128,"data_compressed_original":2312962048,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":132640768,"data_stored":2122252288,"data_compressed":100775895,"data_compressed_allocated":132640768,"data_compressed_original":2122252288,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":167972864,"data_stored":2687500312,"data_compressed":127616893,"data_compressed_allocated":167968768,"data_compressed_original":2687500288,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:04.913 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:05.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:05.066+0000 7efe06357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:05.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:05.073+0000 7efe06357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:07.412 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:07.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:07.561+0000 7f7bb4c18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:07.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:07.569+0000 7f7bb4c18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:09.802 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:09.900 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:09.900 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:09.900 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:09.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:09.938+0000 7fc5d2197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:09.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:09.945+0000 7fc5d2197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:10.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:10.043+0000 7f01d2b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:10.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:10.053+0000 7f01d2b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:10.392 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:06:10.393 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:06:10.409 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-09-22T03:06:09.339376+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3003318859,"num_objects":45823,"num_object_clones":0,"num_object_copies":137469,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":53460,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":53405,"ondisk_log_size":53405,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":829928,"kb_used_data":553252,"kb_used_omap":0,"kb_used_meta":276608,"kb_avail":376657432,"statfs":{"total":386547056640,"available":385697210368,"internally_reserved":0,"allocated":566530048,"data_stored":9049811393,"data_compressed":429726370,"data_compressed_allocated":565608448,"data_compressed_original":9049489408,"omap_allocated":0,"internal_metadata":283246592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-171573248,"num_objects":-2618,"num_object_clones":0,"num_object_copies":-7854,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2618,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002258"},"pg_stats":[{"pgid":"3.f","version":"25'3303","reported_seq":3340,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:04.265247+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:06:04.265247+0000","last_peered":"2024-09-22T03:06:04.265247+0000","last_clean":"2024-09-22T03:06:04.265247+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:06:04.265247+0000","last_undegraded":"2024-09-22T03:06:04.265247+0000","last_fullsized":"2024-09-22T03:06:04.265247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3303,"log_dups_size":0,"ondisk_log_size":3303,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188088320,"num_objects":2870,"num_object_clones":0,"num_object_copies":8610,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3304,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'3384","reported_seq":3421,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.365217+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:06:06.365217+0000","last_peered":"2024-09-22T03:06:06.365217+0000","last_clean":"2024-09-22T03:06:06.365217+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:06:06.365217+0000","last_undegraded":"2024-09-22T03:06:06.365217+0000","last_fullsized":"2024-09-22T03:06:06.365217+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3384,"log_dups_size":0,"ondisk_log_size":3384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190775296,"num_objects":2911,"num_object_clones":0,"num_object_copies":8733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3385,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'3275","reported_seq":3313,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.298170+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:06:06.298170+0000","last_peered":"2024-09-22T03:06:06.298170+0000","last_clean":"2024-09-22T03:06:06.298170+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:06:06.298170+0000","last_undegraded":"2024-09-22T03:06:06.298170+0000","last_fullsized":"2024-09-22T03:06:06.298170+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3275,"log_dups_size":0,"ondisk_log_size":3275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":182124568,"num_objects":2780,"num_object_clones":0,"num_object_copies":8340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3276,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'3307","reported_seq":3344,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:04.186280+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:06:04.186280+0000","last_peered":"2024-09-22T03:06:04.186280+0000","last_clean":"2024-09-22T03:06:04.186280+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:06:04.186280+0000","last_undegraded":"2024-09-22T03:06:04.186280+0000","last_fullsized":"2024-09-22T03:06:04.186280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3307,"log_dups_size":0,"ondisk_log_size":3307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":190578688,"num_objects":2908,"num_object_clones":0,"num_object_copies":8724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3308,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'3292","reported_seq":3329,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.158688+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:06:06.158688+0000","last_peered":"2024-09-22T03:06:06.158688+0000","last_clean":"2024-09-22T03:06:06.158688+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:06:06.158688+0000","last_undegraded":"2024-09-22T03:06:06.158688+0000","last_fullsized":"2024-09-22T03:06:06.158688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3292,"log_dups_size":0,"ondisk_log_size":3292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185139200,"num_objects":2825,"num_object_clones":0,"num_object_copies":8475,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3293,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'3376","reported_seq":3413,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:04.172477+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:06:04.172477+0000","last_peered":"2024-09-22T03:06:04.172477+0000","last_clean":"2024-09-22T03:06:04.172477+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:06:04.172477+0000","last_undegraded":"2024-09-22T03:06:04.172477+0000","last_fullsized":"2024-09-22T03:06:04.172477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3376,"log_dups_size":0,"ondisk_log_size":3376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192086016,"num_objects":2931,"num_object_clones":0,"num_object_copies":8793,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3377,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'3377","reported_seq":3414,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:04.226419+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:06:04.226419+0000","last_peered":"2024-09-22T03:06:04.226419+0000","last_clean":"2024-09-22T03:06:04.226419+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:06:04.226419+0000","last_undegraded":"2024-09-22T03:06:04.226419+0000","last_fullsized":"2024-09-22T03:06:04.226419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3377,"log_dups_size":0,"ondisk_log_size":3377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194904064,"num_objects":2974,"num_object_clones":0,"num_object_copies":8922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3378,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'3339","reported_seq":3376,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.356995+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:06:06.356995+0000","last_peered":"2024-09-22T03:06:06.356995+0000","last_clean":"2024-09-22T03:06:06.356995+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:06:06.356995+0000","last_undegraded":"2024-09-22T03:06:06.356995+0000","last_fullsized":"2024-09-22T03:06:06.356995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3339,"log_dups_size":0,"ondisk_log_size":3339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186646528,"num_objects":2848,"num_object_clones":0,"num_object_copies":8544,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3340,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'3383","reported_seq":3420,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.232061+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:06:06.232061+0000","last_peered":"2024-09-22T03:06:06.232061+0000","last_clean":"2024-09-22T03:06:06.232061+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:06:06.232061+0000","last_undegraded":"2024-09-22T03:06:06.232061+0000","last_fullsized":"2024-09-22T03:06:06.232061+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3383,"log_dups_size":0,"ondisk_log_size":3383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188219392,"num_objects":2872,"num_object_clones":0,"num_object_copies":8616,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3384,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'3264","reported_seq":3301,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.303686+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:06:06.303686+0000","last_peered":"2024-09-22T03:06:06.303686+0000","last_clean":"2024-09-22T03:06:06.303686+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:06:06.303686+0000","last_undegraded":"2024-09-22T03:06:06.303686+0000","last_fullsized":"2024-09-22T03:06:06.303686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3264,"log_dups_size":0,"ondisk_log_size":3264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186187776,"num_objects":2841,"num_object_clones":0,"num_object_copies":8523,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3265,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'3339","reported_seq":3376,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.317563+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:06:06.317563+0000","last_peered":"2024-09-22T03:06:06.317563+0000","last_clean":"2024-09-22T03:06:06.317563+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:06:06.317563+0000","last_undegraded":"2024-09-22T03:06:06.317563+0000","last_fullsized":"2024-09-22T03:06:06.317563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3339,"log_dups_size":0,"ondisk_log_size":3339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185073664,"num_objects":2824,"num_object_clones":0,"num_object_copies":8472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3340,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'3350","reported_seq":3387,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.024315+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:06:06.024315+0000","last_peered":"2024-09-22T03:06:06.024315+0000","last_clean":"2024-09-22T03:06:06.024315+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:06:06.024315+0000","last_undegraded":"2024-09-22T03:06:06.024315+0000","last_fullsized":"2024-09-22T03:06:06.024315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187367424,"num_objects":2859,"num_object_clones":0,"num_object_copies":8577,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3351,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'3254","reported_seq":3291,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.254235+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:06:06.254235+0000","last_peered":"2024-09-22T03:06:06.254235+0000","last_clean":"2024-09-22T03:06:06.254235+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:06:06.254235+0000","last_undegraded":"2024-09-22T03:06:06.254235+0000","last_fullsized":"2024-09-22T03:06:06.254235+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3254,"log_dups_size":0,"ondisk_log_size":3254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":183828480,"num_objects":2805,"num_object_clones":0,"num_object_copies":8415,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3255,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'3386","reported_seq":3423,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.217348+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:06:06.217348+0000","last_peered":"2024-09-22T03:06:06.217348+0000","last_clean":"2024-09-22T03:06:06.217348+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:06:06.217348+0000","last_undegraded":"2024-09-22T03:06:06.217348+0000","last_fullsized":"2024-09-22T03:06:06.217348+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3386,"log_dups_size":0,"ondisk_log_size":3386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187105280,"num_objects":2855,"num_object_clones":0,"num_object_copies":8565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3387,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'3326","reported_seq":3363,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.295997+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:06:06.295997+0000","last_peered":"2024-09-22T03:06:06.295997+0000","last_clean":"2024-09-22T03:06:06.295997+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:06:06.295997+0000","last_undegraded":"2024-09-22T03:06:06.295997+0000","last_fullsized":"2024-09-22T03:06:06.295997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3326,"log_dups_size":0,"ondisk_log_size":3326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185925632,"num_objects":2837,"num_object_clones":0,"num_object_copies":8511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3327,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'3350","reported_seq":3387,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:06.281109+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:06:06.281109+0000","last_peered":"2024-09-22T03:06:06.281109+0000","last_clean":"2024-09-22T03:06:06.281109+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:06:06.281109+0000","last_undegraded":"2024-09-22T03:06:06.281109+0000","last_fullsized":"2024-09-22T03:06:06.281109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3350,"log_dups_size":0,"ondisk_log_size":3350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188678144,"num_objects":2879,"num_object_clones":0,"num_object_copies":8637,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3351,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":3002728472,"num_objects":45819,"num_object_clones":0,"num_object_copies":137457,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":53321,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":562946048,"data_stored":9006940232,"data_compressed":427697708,"data_compressed_allocated":562933760,"data_compressed_original":9006940160,"omap_allocated":0,"internal_metadata":0},"log_size":53305,"ondisk_log_size":53305,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673140,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":227396,"kb_used_data":160304,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94144444,"statfs":{"total":96636764160,"available":96403910656,"internally_reserved":0,"allocated":164151296,"data_stored":2623015139,"data_compressed":124551573,"data_compressed_allocated":163934208,"data_compressed_original":2622947328,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673140,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":193888,"kb_used_data":126800,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94177952,"statfs":{"total":96636764160,"available":96438222848,"internally_reserved":0,"allocated":129843200,"data_stored":2073758443,"data_compressed":98471857,"data_compressed_allocated":129609728,"data_compressed_original":2073673728,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673140,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":217712,"kb_used_data":138144,"kb_used_omap":0,"kb_used_meta":79552,"kb_avail":94154128,"statfs":{"total":96636764160,"available":96413827072,"internally_reserved":0,"allocated":141459456,"data_stored":2259553027,"data_compressed":107294374,"data_compressed_allocated":141221888,"data_compressed_original":2259468288,"omap_allocated":0,"internal_metadata":81461248},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705843,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":190932,"kb_used_data":128004,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94180908,"statfs":{"total":96636764160,"available":96441249792,"internally_reserved":0,"allocated":131076096,"data_stored":2093484784,"data_compressed":99408566,"data_compressed_allocated":130842624,"data_compressed_original":2093400064,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":130199552,"data_stored":2083127320,"data_compressed":98918028,"data_compressed_allocated":130195456,"data_compressed_original":2083127296,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":140541952,"data_stored":2248605720,"data_compressed":106775828,"data_compressed_allocated":140537856,"data_compressed_original":2248605696,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":128962560,"data_stored":2063400960,"data_compressed":97981319,"data_compressed_allocated":128962560,"data_compressed_original":2063400960,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":163241984,"data_stored":2611806232,"data_compressed":124022533,"data_compressed_allocated":163237888,"data_compressed_original":2611806208,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:12.330 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:12.478+0000 7f3f086c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:12.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:12.486+0000 7f3f086c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:14.718 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:14.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:14.852+0000 7f076e86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:14.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:14.859+0000 7f076e86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:15.412 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:15.412 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:15.412 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:06:15.412 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:06:15.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:15.549+0000 7f1c44a72640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:15.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:15.559+0000 7f1c44a72640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:15.590 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:15.590 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:15.593 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:15.593 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:15.593 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:06:15.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:15.732+0000 7f1f9d2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:15.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:15.746+0000 7f1f9d2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:15.792 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:15.792 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:15.792 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:15.792 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:15.792 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:15.792 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:15.792 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:15.792 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:15.795 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:15.795 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:15.795 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:06:15.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:15.935+0000 7f755682c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:15.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:15.946+0000 7f755682c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:16.160 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:16.164 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:16.164 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:16.165 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:06:16.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:16.317+0000 7f102d6b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:16.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:16.329+0000 7f102d6b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:16.351 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:16.351 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:16.352 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:16.352 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:16.352 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:16.352 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:16.352 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:16.352 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:16.352 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:16.352 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:16.352 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:16.352 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:16.356 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:16.357 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:17.179 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:17.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:17.328+0000 7f02772ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:17.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:17.334+0000 7f02772ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:19.640 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:19.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:19.782+0000 7fefae04f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:19.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:19.789+0000 7fefae04f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:21.357 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:21.357 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:21.357 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:21.503+0000 7f1922cb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:21.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:21.514+0000 7f1922cb2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:21.771 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:06:21.772 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:06:21.788 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2024-09-22T03:06:21.341537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2819293771,"num_objects":43015,"num_object_clones":0,"num_object_copies":129045,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":56268,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56213,"ondisk_log_size":56213,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":812748,"kb_used_data":519432,"kb_used_omap":0,"kb_used_meta":293248,"kb_avail":376674612,"statfs":{"total":386547056640,"available":385714802688,"internally_reserved":0,"allocated":531898368,"data_stored":8495704513,"data_compressed":403414410,"data_compressed_allocated":530976768,"data_compressed_original":8495382528,"omap_allocated":0,"internal_metadata":300285952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-184025088,"num_objects":-2808,"num_object_clones":0,"num_object_copies":-8424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2808,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002161"},"pg_stats":[{"pgid":"3.f","version":"25'3528","reported_seq":3565,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:19.212724+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:06:19.212724+0000","last_peered":"2024-09-22T03:06:19.212724+0000","last_clean":"2024-09-22T03:06:19.212724+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:06:19.212724+0000","last_undegraded":"2024-09-22T03:06:19.212724+0000","last_fullsized":"2024-09-22T03:06:19.212724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3528,"log_dups_size":0,"ondisk_log_size":3528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173342720,"num_objects":2645,"num_object_clones":0,"num_object_copies":7935,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3529,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'3563","reported_seq":3600,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:16.273435+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:06:16.273435+0000","last_peered":"2024-09-22T03:06:16.273435+0000","last_clean":"2024-09-22T03:06:16.273435+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:06:16.273435+0000","last_undegraded":"2024-09-22T03:06:16.273435+0000","last_fullsized":"2024-09-22T03:06:16.273435+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3563,"log_dups_size":0,"ondisk_log_size":3563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179044352,"num_objects":2732,"num_object_clones":0,"num_object_copies":8196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3564,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'3416","reported_seq":3454,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:16.324302+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:06:16.324302+0000","last_peered":"2024-09-22T03:06:16.324302+0000","last_clean":"2024-09-22T03:06:16.324302+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:06:16.324302+0000","last_undegraded":"2024-09-22T03:06:16.324302+0000","last_fullsized":"2024-09-22T03:06:16.324302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3416,"log_dups_size":0,"ondisk_log_size":3416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172883992,"num_objects":2639,"num_object_clones":0,"num_object_copies":7917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3417,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'3569","reported_seq":3606,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:19.241216+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:06:19.241216+0000","last_peered":"2024-09-22T03:06:19.241216+0000","last_clean":"2024-09-22T03:06:19.241216+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:06:19.241216+0000","last_undegraded":"2024-09-22T03:06:19.241216+0000","last_fullsized":"2024-09-22T03:06:19.241216+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3569,"log_dups_size":0,"ondisk_log_size":3569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173408256,"num_objects":2646,"num_object_clones":0,"num_object_copies":7938,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3570,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'3444","reported_seq":3481,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:16.235419+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:06:16.235419+0000","last_peered":"2024-09-22T03:06:16.235419+0000","last_clean":"2024-09-22T03:06:16.235419+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:06:16.235419+0000","last_undegraded":"2024-09-22T03:06:16.235419+0000","last_fullsized":"2024-09-22T03:06:16.235419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3444,"log_dups_size":0,"ondisk_log_size":3444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175177728,"num_objects":2673,"num_object_clones":0,"num_object_copies":8019,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3445,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'3611","reported_seq":3648,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:19.264248+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:06:19.264248+0000","last_peered":"2024-09-22T03:06:19.264248+0000","last_clean":"2024-09-22T03:06:19.264248+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:06:19.264248+0000","last_undegraded":"2024-09-22T03:06:19.264248+0000","last_fullsized":"2024-09-22T03:06:19.264248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3611,"log_dups_size":0,"ondisk_log_size":3611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176685056,"num_objects":2696,"num_object_clones":0,"num_object_copies":8088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3612,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'3614","reported_seq":3651,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:19.045887+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:06:19.045887+0000","last_peered":"2024-09-22T03:06:19.045887+0000","last_clean":"2024-09-22T03:06:19.045887+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:06:19.045887+0000","last_undegraded":"2024-09-22T03:06:19.045887+0000","last_fullsized":"2024-09-22T03:06:19.045887+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3614,"log_dups_size":0,"ondisk_log_size":3614,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179372032,"num_objects":2737,"num_object_clones":0,"num_object_copies":8211,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3615,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'3493","reported_seq":3530,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:16.116031+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:06:16.116031+0000","last_peered":"2024-09-22T03:06:16.116031+0000","last_clean":"2024-09-22T03:06:16.116031+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:06:16.116031+0000","last_undegraded":"2024-09-22T03:06:16.116031+0000","last_fullsized":"2024-09-22T03:06:16.116031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3493,"log_dups_size":0,"ondisk_log_size":3493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176553984,"num_objects":2694,"num_object_clones":0,"num_object_copies":8082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3494,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'3538","reported_seq":3575,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:16.315863+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:06:16.315863+0000","last_peered":"2024-09-22T03:06:16.315863+0000","last_clean":"2024-09-22T03:06:16.315863+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:06:16.315863+0000","last_undegraded":"2024-09-22T03:06:16.315863+0000","last_fullsized":"2024-09-22T03:06:16.315863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3538,"log_dups_size":0,"ondisk_log_size":3538,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178061312,"num_objects":2717,"num_object_clones":0,"num_object_copies":8151,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3539,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'3417","reported_seq":3454,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:16.205684+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:06:16.205684+0000","last_peered":"2024-09-22T03:06:16.205684+0000","last_clean":"2024-09-22T03:06:16.205684+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:06:16.205684+0000","last_undegraded":"2024-09-22T03:06:16.205684+0000","last_fullsized":"2024-09-22T03:06:16.205684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3417,"log_dups_size":0,"ondisk_log_size":3417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160768,"num_objects":2688,"num_object_clones":0,"num_object_copies":8064,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3418,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'3492","reported_seq":3529,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:16.086597+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:06:16.086597+0000","last_peered":"2024-09-22T03:06:16.086597+0000","last_clean":"2024-09-22T03:06:16.086597+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:06:16.086597+0000","last_undegraded":"2024-09-22T03:06:16.086597+0000","last_fullsized":"2024-09-22T03:06:16.086597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3492,"log_dups_size":0,"ondisk_log_size":3492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175046656,"num_objects":2671,"num_object_clones":0,"num_object_copies":8013,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3493,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'3505","reported_seq":3542,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:16.323597+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:06:16.323597+0000","last_peered":"2024-09-22T03:06:16.323597+0000","last_clean":"2024-09-22T03:06:16.323597+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:06:16.323597+0000","last_undegraded":"2024-09-22T03:06:16.323597+0000","last_fullsized":"2024-09-22T03:06:16.323597+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3505,"log_dups_size":0,"ondisk_log_size":3505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":177209344,"num_objects":2704,"num_object_clones":0,"num_object_copies":8112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3506,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'3389","reported_seq":3426,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:16.248750+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:06:16.248750+0000","last_peered":"2024-09-22T03:06:16.248750+0000","last_clean":"2024-09-22T03:06:16.248750+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:06:16.248750+0000","last_undegraded":"2024-09-22T03:06:16.248750+0000","last_fullsized":"2024-09-22T03:06:16.248750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3389,"log_dups_size":0,"ondisk_log_size":3389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174981120,"num_objects":2670,"num_object_clones":0,"num_object_copies":8010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3390,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'3542","reported_seq":3579,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:16.365490+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:06:16.365490+0000","last_peered":"2024-09-22T03:06:16.365490+0000","last_clean":"2024-09-22T03:06:16.365490+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:06:16.365490+0000","last_undegraded":"2024-09-22T03:06:16.365490+0000","last_fullsized":"2024-09-22T03:06:16.365490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3542,"log_dups_size":0,"ondisk_log_size":3542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176881664,"num_objects":2699,"num_object_clones":0,"num_object_copies":8097,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3543,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'3488","reported_seq":3525,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:16.213093+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:06:16.213093+0000","last_peered":"2024-09-22T03:06:16.213093+0000","last_clean":"2024-09-22T03:06:16.213093+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:06:16.213093+0000","last_undegraded":"2024-09-22T03:06:16.213093+0000","last_fullsized":"2024-09-22T03:06:16.213093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3488,"log_dups_size":0,"ondisk_log_size":3488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":175308800,"num_objects":2675,"num_object_clones":0,"num_object_copies":8025,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3489,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'3504","reported_seq":3541,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:15.966776+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:06:15.966776+0000","last_peered":"2024-09-22T03:06:15.966776+0000","last_clean":"2024-09-22T03:06:15.966776+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:06:15.966776+0000","last_undegraded":"2024-09-22T03:06:15.966776+0000","last_fullsized":"2024-09-22T03:06:15.966776+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3504,"log_dups_size":0,"ondisk_log_size":3504,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":178585600,"num_objects":2725,"num_object_clones":0,"num_object_copies":8175,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3505,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2818703384,"num_objects":43011,"num_object_clones":0,"num_object_copies":129033,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":56129,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528674816,"data_stored":8458600520,"data_compressed":401659604,"data_compressed_allocated":528662528,"data_compressed_original":8458600448,"omap_allocated":0,"internal_metadata":0},"log_size":56113,"ondisk_log_size":56113,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":226912,"kb_used_data":151504,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94144928,"statfs":{"total":96636764160,"available":96404406272,"internally_reserved":0,"allocated":155140096,"data_stored":2478835939,"data_compressed":117705173,"data_compressed_allocated":154923008,"data_compressed_original":2478768128,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":195088,"kb_used_data":119680,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94176752,"statfs":{"total":96636764160,"available":96436994048,"internally_reserved":0,"allocated":122552320,"data_stored":1957104363,"data_compressed":92932497,"data_compressed_allocated":122318848,"data_compressed_original":1957019648,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":197740,"kb_used_data":130652,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94174100,"statfs":{"total":96636764160,"available":96434278400,"internally_reserved":0,"allocated":133787648,"data_stored":2136804099,"data_compressed":101465598,"data_compressed_allocated":133550080,"data_compressed_original":2136719360,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705858,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":193008,"kb_used_data":117596,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94178832,"statfs":{"total":96636764160,"available":96439123968,"internally_reserved":0,"allocated":120418304,"data_stored":1922960112,"data_compressed":91311142,"data_compressed_allocated":120184832,"data_compressed_original":1922875392,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":119611392,"data_stored":1913716760,"data_compressed":90873508,"data_compressed_allocated":119607296,"data_compressed_original":1913716736,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":132976640,"data_stored":2127560728,"data_compressed":101027964,"data_compressed_allocated":132972544,"data_compressed_original":2127560704,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":121794560,"data_stored":1948712960,"data_compressed":92535319,"data_compressed_allocated":121794560,"data_compressed_original":1948712960,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":154292224,"data_stored":2468610072,"data_compressed":117222813,"data_compressed_allocated":154288128,"data_compressed_original":2468610048,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:22.037 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:22.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:22.180+0000 7f5b3bd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:22.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:22.186+0000 7f5b3bd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:24.460 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:24.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:24.586+0000 7fc9ccb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:24.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:24.594+0000 7fc9ccb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:26.791 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:26.791 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:26.791 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:26.810 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:26.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:26.925+0000 7f1908b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:26.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:26.935+0000 7f1908b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:26.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:26.986+0000 7f7033b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:26.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:26.994+0000 7f7033b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:27.195 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:06:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:06:27.214 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2024-09-22T03:06:25.342279+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2736259659,"num_objects":41748,"num_object_clones":0,"num_object_copies":125244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":57535,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57480,"ondisk_log_size":57480,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":764600,"kb_used_data":504564,"kb_used_omap":0,"kb_used_meta":259968,"kb_avail":376722760,"statfs":{"total":386547056640,"available":385764106240,"internally_reserved":0,"allocated":516673536,"data_stored":8252107201,"data_compressed":391847106,"data_compressed_allocated":515751936,"data_compressed_original":8251785216,"omap_allocated":0,"internal_metadata":266207232},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-183304192,"num_objects":-2797,"num_object_clones":0,"num_object_copies":-8391,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2797,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002166"},"pg_stats":[{"pgid":"3.f","version":"25'3601","reported_seq":3638,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:24.118248+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:06:24.118248+0000","last_peered":"2024-09-22T03:06:24.118248+0000","last_clean":"2024-09-22T03:06:24.118248+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:06:24.118248+0000","last_undegraded":"2024-09-22T03:06:24.118248+0000","last_fullsized":"2024-09-22T03:06:24.118248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3601,"log_dups_size":0,"ondisk_log_size":3601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168558592,"num_objects":2572,"num_object_clones":0,"num_object_copies":7716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3602,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'3665","reported_seq":3702,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.364370+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:06:21.364370+0000","last_peered":"2024-09-22T03:06:21.364370+0000","last_clean":"2024-09-22T03:06:21.364370+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:06:21.364370+0000","last_undegraded":"2024-09-22T03:06:21.364370+0000","last_fullsized":"2024-09-22T03:06:21.364370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3665,"log_dups_size":0,"ondisk_log_size":3665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172359680,"num_objects":2630,"num_object_clones":0,"num_object_copies":7890,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3666,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'3489","reported_seq":3527,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.238316+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:06:21.238316+0000","last_peered":"2024-09-22T03:06:21.238316+0000","last_clean":"2024-09-22T03:06:21.238316+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:06:21.238316+0000","last_undegraded":"2024-09-22T03:06:21.238316+0000","last_fullsized":"2024-09-22T03:06:21.238316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3489,"log_dups_size":0,"ondisk_log_size":3489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168099864,"num_objects":2566,"num_object_clones":0,"num_object_copies":7698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3490,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'3653","reported_seq":3690,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:24.261635+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:06:24.261635+0000","last_peered":"2024-09-22T03:06:24.261635+0000","last_clean":"2024-09-22T03:06:24.261635+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:06:24.261635+0000","last_undegraded":"2024-09-22T03:06:24.261635+0000","last_fullsized":"2024-09-22T03:06:24.261635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3653,"log_dups_size":0,"ondisk_log_size":3653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167903232,"num_objects":2562,"num_object_clones":0,"num_object_copies":7686,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3654,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'3526","reported_seq":3563,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.301570+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:06:21.301570+0000","last_peered":"2024-09-22T03:06:21.301570+0000","last_clean":"2024-09-22T03:06:21.301570+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:06:21.301570+0000","last_undegraded":"2024-09-22T03:06:21.301570+0000","last_fullsized":"2024-09-22T03:06:21.301570+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3526,"log_dups_size":0,"ondisk_log_size":3526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169803776,"num_objects":2591,"num_object_clones":0,"num_object_copies":7773,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3527,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'3699","reported_seq":3736,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:24.244731+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:06:24.244731+0000","last_peered":"2024-09-22T03:06:24.244731+0000","last_clean":"2024-09-22T03:06:24.244731+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:06:24.244731+0000","last_undegraded":"2024-09-22T03:06:24.244731+0000","last_fullsized":"2024-09-22T03:06:24.244731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3699,"log_dups_size":0,"ondisk_log_size":3699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170917888,"num_objects":2608,"num_object_clones":0,"num_object_copies":7824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3700,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'3692","reported_seq":3729,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:24.280547+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:06:24.280547+0000","last_peered":"2024-09-22T03:06:24.280547+0000","last_clean":"2024-09-22T03:06:24.280547+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:06:24.280547+0000","last_undegraded":"2024-09-22T03:06:24.280547+0000","last_fullsized":"2024-09-22T03:06:24.280547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3692,"log_dups_size":0,"ondisk_log_size":3692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174260224,"num_objects":2659,"num_object_clones":0,"num_object_copies":7977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3693,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'3563","reported_seq":3600,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.238865+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:06:21.238865+0000","last_peered":"2024-09-22T03:06:21.238865+0000","last_clean":"2024-09-22T03:06:21.238865+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:06:21.238865+0000","last_undegraded":"2024-09-22T03:06:21.238865+0000","last_fullsized":"2024-09-22T03:06:21.238865+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3563,"log_dups_size":0,"ondisk_log_size":3563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171966464,"num_objects":2624,"num_object_clones":0,"num_object_copies":7872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3564,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'3611","reported_seq":3648,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.344593+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:06:21.344593+0000","last_peered":"2024-09-22T03:06:21.344593+0000","last_clean":"2024-09-22T03:06:21.344593+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:06:21.344593+0000","last_undegraded":"2024-09-22T03:06:21.344593+0000","last_fullsized":"2024-09-22T03:06:21.344593+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3611,"log_dups_size":0,"ondisk_log_size":3611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173277184,"num_objects":2644,"num_object_clones":0,"num_object_copies":7932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3612,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'3492","reported_seq":3529,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.332225+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:06:21.332225+0000","last_peered":"2024-09-22T03:06:21.332225+0000","last_clean":"2024-09-22T03:06:21.332225+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:06:21.332225+0000","last_undegraded":"2024-09-22T03:06:21.332225+0000","last_fullsized":"2024-09-22T03:06:21.332225+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3492,"log_dups_size":0,"ondisk_log_size":3492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171245568,"num_objects":2613,"num_object_clones":0,"num_object_copies":7839,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3493,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'3571","reported_seq":3608,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.293040+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:06:21.293040+0000","last_peered":"2024-09-22T03:06:21.293040+0000","last_clean":"2024-09-22T03:06:21.293040+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:06:21.293040+0000","last_undegraded":"2024-09-22T03:06:21.293040+0000","last_fullsized":"2024-09-22T03:06:21.293040+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3571,"log_dups_size":0,"ondisk_log_size":3571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169869312,"num_objects":2592,"num_object_clones":0,"num_object_copies":7776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3572,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'3587","reported_seq":3624,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.321292+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:06:21.321292+0000","last_peered":"2024-09-22T03:06:21.321292+0000","last_clean":"2024-09-22T03:06:21.321292+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:06:21.321292+0000","last_undegraded":"2024-09-22T03:06:21.321292+0000","last_fullsized":"2024-09-22T03:06:21.321292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3587,"log_dups_size":0,"ondisk_log_size":3587,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171835392,"num_objects":2622,"num_object_clones":0,"num_object_copies":7866,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3588,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'3471","reported_seq":3508,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.222433+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:06:21.222433+0000","last_peered":"2024-09-22T03:06:21.222433+0000","last_clean":"2024-09-22T03:06:21.222433+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:06:21.222433+0000","last_undegraded":"2024-09-22T03:06:21.222433+0000","last_fullsized":"2024-09-22T03:06:21.222433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3471,"log_dups_size":0,"ondisk_log_size":3471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169607168,"num_objects":2588,"num_object_clones":0,"num_object_copies":7764,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3472,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'3613","reported_seq":3650,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.226231+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:06:21.226231+0000","last_peered":"2024-09-22T03:06:21.226231+0000","last_clean":"2024-09-22T03:06:21.226231+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:06:21.226231+0000","last_undegraded":"2024-09-22T03:06:21.226231+0000","last_fullsized":"2024-09-22T03:06:21.226231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3613,"log_dups_size":0,"ondisk_log_size":3613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":172228608,"num_objects":2628,"num_object_clones":0,"num_object_copies":7884,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3614,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'3568","reported_seq":3605,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.194503+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:06:21.194503+0000","last_peered":"2024-09-22T03:06:21.194503+0000","last_clean":"2024-09-22T03:06:21.194503+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:06:21.194503+0000","last_undegraded":"2024-09-22T03:06:21.194503+0000","last_fullsized":"2024-09-22T03:06:21.194503+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3568,"log_dups_size":0,"ondisk_log_size":3568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170065920,"num_objects":2595,"num_object_clones":0,"num_object_copies":7785,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3569,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'3579","reported_seq":3616,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:21.326320+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:06:21.326320+0000","last_peered":"2024-09-22T03:06:21.326320+0000","last_clean":"2024-09-22T03:06:21.326320+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:06:21.326320+0000","last_undegraded":"2024-09-22T03:06:21.326320+0000","last_fullsized":"2024-09-22T03:06:21.326320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3579,"log_dups_size":0,"ondisk_log_size":3579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":173670400,"num_objects":2650,"num_object_clones":0,"num_object_copies":7950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3580,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2735669272,"num_objects":41744,"num_object_clones":0,"num_object_copies":125232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":57396,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":513359872,"data_stored":8213561416,"data_compressed":390023836,"data_compressed_allocated":513347584,"data_compressed_original":8213561344,"omap_allocated":0,"internal_metadata":0},"log_size":57380,"ondisk_log_size":57380,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673155,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":210088,"kb_used_data":147160,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94161752,"statfs":{"total":96636764160,"available":96421634048,"internally_reserved":0,"allocated":150691840,"data_stored":2407663843,"data_compressed":114325541,"data_compressed_allocated":150474752,"data_compressed_original":2407596032,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673155,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":179208,"kb_used_data":116280,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94192632,"statfs":{"total":96636764160,"available":96453255168,"internally_reserved":0,"allocated":119070720,"data_stored":1901398763,"data_compressed":90287297,"data_compressed_allocated":118837248,"data_compressed_original":1901314048,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673155,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":198164,"kb_used_data":126912,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94173676,"statfs":{"total":96636764160,"available":96433844224,"internally_reserved":0,"allocated":129957888,"data_stored":2075527939,"data_compressed":98555878,"data_compressed_allocated":129720320,"data_compressed_original":2075443200,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":177140,"kb_used_data":114212,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94194700,"statfs":{"total":96636764160,"available":96455372800,"internally_reserved":0,"allocated":116953088,"data_stored":1867516656,"data_compressed":88678390,"data_compressed_allocated":116719616,"data_compressed_original":1867431936,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":116154368,"data_stored":1858404376,"data_compressed":88246980,"data_compressed_allocated":116150272,"data_compressed_original":1858404352,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":129159168,"data_stored":2066481176,"data_compressed":98127580,"data_compressed_allocated":129155072,"data_compressed_original":2066481152,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":118218752,"data_stored":1891500032,"data_compressed":89818543,"data_compressed_allocated":118218752,"data_compressed_original":1891500032,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":149827584,"data_stored":2397175832,"data_compressed":113830733,"data_compressed_allocated":149823488,"data_compressed_original":2397175808,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:29.310 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:29.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:29.457+0000 7f311a4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:29.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:29.464+0000 7f311a4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:31.810 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:31.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:31.945+0000 7faabd66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:31.952+0000 7faabd66c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:32.216 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:32.216 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:32.217 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:32.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:32.359+0000 7f374046c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:32.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:32.372+0000 7f374046c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:32.628 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:06:32.628 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:06:32.645 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-09-22T03:06:31.343290+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2657747531,"num_objects":40550,"num_object_clones":0,"num_object_copies":121650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":58733,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":58678,"ondisk_log_size":58678,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":766556,"kb_used_data":489856,"kb_used_omap":0,"kb_used_meta":276608,"kb_avail":376720804,"statfs":{"total":386547056640,"available":385762103296,"internally_reserved":0,"allocated":501612544,"data_stored":8011131329,"data_compressed":380404282,"data_compressed_allocated":500690944,"data_compressed_original":8010809344,"omap_allocated":0,"internal_metadata":283246592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-181141504,"num_objects":-2764,"num_object_clones":0,"num_object_copies":-8292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2764,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002025"},"pg_stats":[{"pgid":"3.f","version":"25'3673","reported_seq":3710,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:29.040794+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:06:29.040794+0000","last_peered":"2024-09-22T03:06:29.040794+0000","last_clean":"2024-09-22T03:06:29.040794+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:06:29.040794+0000","last_undegraded":"2024-09-22T03:06:29.040794+0000","last_fullsized":"2024-09-22T03:06:29.040794+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3673,"log_dups_size":0,"ondisk_log_size":3673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163840000,"num_objects":2500,"num_object_clones":0,"num_object_copies":7500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3674,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'3734","reported_seq":3771,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:26.210164+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:06:26.210164+0000","last_peered":"2024-09-22T03:06:26.210164+0000","last_clean":"2024-09-22T03:06:26.210164+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:06:26.210164+0000","last_undegraded":"2024-09-22T03:06:26.210164+0000","last_fullsized":"2024-09-22T03:06:26.210164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3734,"log_dups_size":0,"ondisk_log_size":3734,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167837696,"num_objects":2561,"num_object_clones":0,"num_object_copies":7683,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3735,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'3563","reported_seq":3601,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:26.327626+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:06:26.327626+0000","last_peered":"2024-09-22T03:06:26.327626+0000","last_clean":"2024-09-22T03:06:26.327626+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:06:26.327626+0000","last_undegraded":"2024-09-22T03:06:26.327626+0000","last_fullsized":"2024-09-22T03:06:26.327626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3563,"log_dups_size":0,"ondisk_log_size":3563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163250200,"num_objects":2492,"num_object_clones":0,"num_object_copies":7476,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3564,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'3717","reported_seq":3754,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:29.261201+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:06:29.261201+0000","last_peered":"2024-09-22T03:06:29.261201+0000","last_clean":"2024-09-22T03:06:29.261201+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:06:29.261201+0000","last_undegraded":"2024-09-22T03:06:29.261201+0000","last_fullsized":"2024-09-22T03:06:29.261201+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3717,"log_dups_size":0,"ondisk_log_size":3717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163708928,"num_objects":2498,"num_object_clones":0,"num_object_copies":7494,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3718,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'3609","reported_seq":3646,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:26.320434+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:06:26.320434+0000","last_peered":"2024-09-22T03:06:26.320434+0000","last_clean":"2024-09-22T03:06:26.320434+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:06:26.320434+0000","last_undegraded":"2024-09-22T03:06:26.320434+0000","last_fullsized":"2024-09-22T03:06:26.320434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3609,"log_dups_size":0,"ondisk_log_size":3609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164364288,"num_objects":2508,"num_object_clones":0,"num_object_copies":7524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3610,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'3769","reported_seq":3806,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:29.226936+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:06:29.226936+0000","last_peered":"2024-09-22T03:06:29.226936+0000","last_clean":"2024-09-22T03:06:29.226936+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:06:29.226936+0000","last_undegraded":"2024-09-22T03:06:29.226936+0000","last_fullsized":"2024-09-22T03:06:29.226936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3769,"log_dups_size":0,"ondisk_log_size":3769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166330368,"num_objects":2538,"num_object_clones":0,"num_object_copies":7614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3770,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'3781","reported_seq":3818,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:29.181456+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:06:29.181456+0000","last_peered":"2024-09-22T03:06:29.181456+0000","last_clean":"2024-09-22T03:06:29.181456+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:06:29.181456+0000","last_undegraded":"2024-09-22T03:06:29.181456+0000","last_fullsized":"2024-09-22T03:06:29.181456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3781,"log_dups_size":0,"ondisk_log_size":3781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168427520,"num_objects":2570,"num_object_clones":0,"num_object_copies":7710,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3782,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'3631","reported_seq":3668,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:26.085926+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:06:26.085926+0000","last_peered":"2024-09-22T03:06:26.085926+0000","last_clean":"2024-09-22T03:06:26.085926+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:06:26.085926+0000","last_undegraded":"2024-09-22T03:06:26.085926+0000","last_fullsized":"2024-09-22T03:06:26.085926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3631,"log_dups_size":0,"ondisk_log_size":3631,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167510016,"num_objects":2556,"num_object_clones":0,"num_object_copies":7668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3632,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'3675","reported_seq":3712,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:26.095113+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:06:26.095113+0000","last_peered":"2024-09-22T03:06:26.095113+0000","last_clean":"2024-09-22T03:06:26.095113+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:06:26.095113+0000","last_undegraded":"2024-09-22T03:06:26.095113+0000","last_fullsized":"2024-09-22T03:06:26.095113+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3675,"log_dups_size":0,"ondisk_log_size":3675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169082880,"num_objects":2580,"num_object_clones":0,"num_object_copies":7740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3676,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'3550","reported_seq":3587,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:26.198566+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:06:26.198566+0000","last_peered":"2024-09-22T03:06:26.198566+0000","last_clean":"2024-09-22T03:06:26.198566+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:06:26.198566+0000","last_undegraded":"2024-09-22T03:06:26.198566+0000","last_fullsized":"2024-09-22T03:06:26.198566+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3550,"log_dups_size":0,"ondisk_log_size":3550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167444480,"num_objects":2555,"num_object_clones":0,"num_object_copies":7665,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3551,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'3655","reported_seq":3692,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:26.291080+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:06:26.291080+0000","last_peered":"2024-09-22T03:06:26.291080+0000","last_clean":"2024-09-22T03:06:26.291080+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:06:26.291080+0000","last_undegraded":"2024-09-22T03:06:26.291080+0000","last_fullsized":"2024-09-22T03:06:26.291080+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3655,"log_dups_size":0,"ondisk_log_size":3655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164364288,"num_objects":2508,"num_object_clones":0,"num_object_copies":7524,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3656,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'3676","reported_seq":3713,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:26.185508+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:06:26.185508+0000","last_peered":"2024-09-22T03:06:26.185508+0000","last_clean":"2024-09-22T03:06:26.185508+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:06:26.185508+0000","last_undegraded":"2024-09-22T03:06:26.185508+0000","last_fullsized":"2024-09-22T03:06:26.185508+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3676,"log_dups_size":0,"ondisk_log_size":3676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166002688,"num_objects":2533,"num_object_clones":0,"num_object_copies":7599,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3677,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'3558","reported_seq":3595,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:26.329326+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:06:26.329326+0000","last_peered":"2024-09-22T03:06:26.329326+0000","last_clean":"2024-09-22T03:06:26.329326+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:06:26.329326+0000","last_undegraded":"2024-09-22T03:06:26.329326+0000","last_fullsized":"2024-09-22T03:06:26.329326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3558,"log_dups_size":0,"ondisk_log_size":3558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163905536,"num_objects":2501,"num_object_clones":0,"num_object_copies":7503,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3559,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'3698","reported_seq":3735,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:26.359690+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:06:26.359690+0000","last_peered":"2024-09-22T03:06:26.359690+0000","last_clean":"2024-09-22T03:06:26.359690+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:06:26.359690+0000","last_undegraded":"2024-09-22T03:06:26.359690+0000","last_fullsized":"2024-09-22T03:06:26.359690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3698,"log_dups_size":0,"ondisk_log_size":3698,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166658048,"num_objects":2543,"num_object_clones":0,"num_object_copies":7629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3699,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'3636","reported_seq":3673,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:26.314426+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:06:26.314426+0000","last_peered":"2024-09-22T03:06:26.314426+0000","last_clean":"2024-09-22T03:06:26.314426+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:06:26.314426+0000","last_undegraded":"2024-09-22T03:06:26.314426+0000","last_fullsized":"2024-09-22T03:06:26.314426+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3636,"log_dups_size":0,"ondisk_log_size":3636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":165609472,"num_objects":2527,"num_object_clones":0,"num_object_copies":7581,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3637,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'3653","reported_seq":3690,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:26.087439+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:06:26.087439+0000","last_peered":"2024-09-22T03:06:26.087439+0000","last_clean":"2024-09-22T03:06:26.087439+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:06:26.087439+0000","last_undegraded":"2024-09-22T03:06:26.087439+0000","last_fullsized":"2024-09-22T03:06:26.087439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3653,"log_dups_size":0,"ondisk_log_size":3653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168820736,"num_objects":2576,"num_object_clones":0,"num_object_copies":7728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3654,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2657157144,"num_objects":40546,"num_object_clones":0,"num_object_copies":121638,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":58594,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":498372608,"data_stored":7973765192,"data_compressed":378637028,"data_compressed_allocated":498360320,"data_compressed_original":7973765120,"omap_allocated":0,"internal_metadata":0},"log_size":58578,"ondisk_log_size":58578,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":210000,"kb_used_data":142900,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94161840,"statfs":{"total":96636764160,"available":96421724160,"internally_reserved":0,"allocated":146329600,"data_stored":2337868003,"data_compressed":111011261,"data_compressed_allocated":146112512,"data_compressed_original":2337800192,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":179984,"kb_used_data":112892,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94191856,"statfs":{"total":96636764160,"available":96452460544,"internally_reserved":0,"allocated":115601408,"data_stored":1845889771,"data_compressed":87651433,"data_compressed_allocated":115367936,"data_compressed_original":1845805056,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":198620,"kb_used_data":123204,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94173220,"statfs":{"total":96636764160,"available":96433377280,"internally_reserved":0,"allocated":126160896,"data_stored":2014776067,"data_compressed":95671054,"data_compressed_allocated":125923328,"data_compressed_original":2014691328,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":177952,"kb_used_data":110860,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94193888,"statfs":{"total":96636764160,"available":96454541312,"internally_reserved":0,"allocated":113520640,"data_stored":1812597488,"data_compressed":86070534,"data_compressed_allocated":113287168,"data_compressed_original":1812512768,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":112766976,"data_stored":1804206104,"data_compressed":85673356,"data_compressed_allocated":112762880,"data_compressed_original":1804206080,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":125308928,"data_stored":2004877336,"data_compressed":95202300,"data_compressed_allocated":125304832,"data_compressed_original":2004877312,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114802688,"data_stored":1836843008,"data_compressed":87223135,"data_compressed_allocated":114802688,"data_compressed_original":1836843008,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":145494016,"data_stored":2327838744,"data_compressed":110538237,"data_compressed_allocated":145489920,"data_compressed_original":2327838720,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:34.297 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:34.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:34.437+0000 7f6e2fc4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:34.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:34.443+0000 7f6e2fc4f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:36.755 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:36.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:36.897+0000 7f341d4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:36.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:36.904+0000 7f341d4d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:37.647 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:37.647 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:37.647 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:06:37.647 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:06:37.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:37.794+0000 7fc1f5f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:37.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:37.809+0000 7fc1f5f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:37.894 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:37.894 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:37.895 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:37.895 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:37.895 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:37.895 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:37.895 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:37.895 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:37.895 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:37.895 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:37.895 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:37.895 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:37.899 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:37.899 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:37.900 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:06:38.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:38.038+0000 7fca81357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:38.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:38.051+0000 7fca81357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:38.120 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:38.120 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:38.120 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:38.120 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:38.120 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:38.120 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:38.120 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:38.120 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:38.120 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:38.121 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:38.121 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:38.121 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:38.124 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:38.124 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:38.124 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:06:38.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:38.264+0000 7ff6fd397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:38.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:38.276+0000 7ff6fd397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:38.302 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:38.302 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:38.302 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:38.302 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:38.302 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:38.302 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:38.302 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:38.302 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:38.302 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:38.302 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:38.302 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:38.303 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:38.305 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:38.306 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:38.306 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:06:38.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:38.450+0000 7f4d99157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:38.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:38.461+0000 7f4d99157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:38.488 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:38.488 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:38.488 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:38.488 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:38.488 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:38.489 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:38.489 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:38.489 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:38.489 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:38.489 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:38.489 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:38.489 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:38.491 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:38.492 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:39.096 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:39.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:39.230+0000 7f3d8d397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:39.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:39.236+0000 7f3d8d397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:41.531 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:41.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:41.664+0000 7f0194b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:41.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:41.670+0000 7f0194b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:43.493 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:43.493 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:43.493 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:06:43.494 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:06:43.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:43.643+0000 7fc322f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:43.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:43.656+0000 7fc322f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:43.692 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:43.692 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:43.693 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:43.693 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:43.693 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:43.693 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:43.693 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:43.693 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:43.693 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:43.693 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:43.693 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:43.693 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:43.696 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:43.696 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:43.697 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:06:43.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:43.847+0000 7f1c17f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:43.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:43.857+0000 7f1c17f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:44.015 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:44.015 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:44.015 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:44.015 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:44.016 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:44.016 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:44.016 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:44.016 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:44.016 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:44.016 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:44.016 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:44.016 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:44.018 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:44.019 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:44.019 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:44.019 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:06:44.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:44.164+0000 7fa8e7197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:44.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:44.170+0000 7fa8e7197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:44.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:44.165+0000 7f5b74d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:44.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:44.178+0000 7f5b74d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:44.263 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:44.263 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:44.263 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:44.264 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:44.264 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:44.264 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:44.264 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:44.264 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:44.264 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:44.264 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:44.264 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:44.264 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:44.267 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:44.267 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:44.268 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:06:44.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:44.422+0000 7f0435e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:44.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:44.434+0000 7f0435e2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:44.454 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:44.454 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:44.454 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:44.454 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:44.454 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:44.454 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:44.454 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:44.455 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:44.455 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:44.455 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:44.455 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:44.455 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:44.458 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:44.458 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:46.414 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:46.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:46.552+0000 7f6e56ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:46.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:46.559+0000 7f6e56ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:48.790 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:48.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:48.922+0000 7f4d25c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:48.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:48.928+0000 7f4d25c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:49.459 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:49.460 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:49.460 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:06:49.460 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:06:49.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:49.596+0000 7fe4bd42c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:49.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:49.611+0000 7fe4bd42c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:49.710 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:49.710 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:49.710 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:49.710 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:49.711 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:49.711 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:49.711 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:49.711 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:49.711 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:49.711 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:49.711 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:49.711 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:49.714 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:49.715 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:49.715 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:06:49.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:49.866+0000 7f4c46957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:49.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:49.876+0000 7f4c46957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:49.958 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:49.959 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:49.962 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:49.962 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:49.962 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:06:50.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:50.101+0000 7f254946c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:50.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:50.110+0000 7f254946c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:50.131 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:50.132 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:50.133 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:50.134 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:50.134 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:06:50.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:50.278+0000 7eff79d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:50.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:50.288+0000 7eff79d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:50.339 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:06:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:06:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:06:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:06:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:06:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:06:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:06:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:06:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:06:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:06:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:06:50.340 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:06:50.342 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:06:50.343 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:06:51.219 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:51.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:51.369+0000 7f0aa5d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:51.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:51.376+0000 7f0aa5d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:53.591 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:53.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:53.731+0000 7f14f4517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:53.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:53.737+0000 7f14f4517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:55.344 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:06:55.344 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:06:55.344 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:06:55.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:55.478+0000 7fead3f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:55.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:55.486+0000 7fead3f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:55.766 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:06:55.766 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:06:55.781 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-09-22T03:06:55.347355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2275148363,"num_objects":34712,"num_object_clones":0,"num_object_copies":104136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":64571,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64516,"ondisk_log_size":64516,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":714496,"kb_used_data":419768,"kb_used_omap":0,"kb_used_meta":294656,"kb_avail":376772864,"statfs":{"total":386547056640,"available":385815412736,"internally_reserved":0,"allocated":429842432,"data_stored":6862809537,"data_compressed":325875821,"data_compressed_allocated":428920832,"data_compressed_original":6862487552,"omap_allocated":0,"internal_metadata":301727744},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-168099840,"num_objects":-2565,"num_object_clones":0,"num_object_copies":-7695,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2565,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002176"},"pg_stats":[{"pgid":"3.f","version":"25'4046","reported_seq":4083,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:54.280696+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:06:54.280696+0000","last_peered":"2024-09-22T03:06:54.280696+0000","last_clean":"2024-09-22T03:06:54.280696+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:06:54.280696+0000","last_undegraded":"2024-09-22T03:06:54.280696+0000","last_fullsized":"2024-09-22T03:06:54.280696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4046,"log_dups_size":0,"ondisk_log_size":4046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139395072,"num_objects":2127,"num_object_clones":0,"num_object_copies":6381,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4047,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'4094","reported_seq":4131,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:51.163701+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:06:51.163701+0000","last_peered":"2024-09-22T03:06:51.163701+0000","last_clean":"2024-09-22T03:06:51.163701+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:06:51.163701+0000","last_undegraded":"2024-09-22T03:06:51.163701+0000","last_fullsized":"2024-09-22T03:06:51.163701+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4094,"log_dups_size":0,"ondisk_log_size":4094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144244736,"num_objects":2201,"num_object_clones":0,"num_object_copies":6603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4095,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'3921","reported_seq":3959,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:51.194732+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:06:51.194732+0000","last_peered":"2024-09-22T03:06:51.194732+0000","last_clean":"2024-09-22T03:06:51.194732+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:06:51.194732+0000","last_undegraded":"2024-09-22T03:06:51.194732+0000","last_fullsized":"2024-09-22T03:06:51.194732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3921,"log_dups_size":0,"ondisk_log_size":3921,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139788312,"num_objects":2134,"num_object_clones":0,"num_object_copies":6402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3922,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'4085","reported_seq":4122,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:54.229740+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:06:54.229740+0000","last_peered":"2024-09-22T03:06:54.229740+0000","last_clean":"2024-09-22T03:06:54.229740+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:06:54.229740+0000","last_undegraded":"2024-09-22T03:06:54.229740+0000","last_fullsized":"2024-09-22T03:06:54.229740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4085,"log_dups_size":0,"ondisk_log_size":4085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139591680,"num_objects":2130,"num_object_clones":0,"num_object_copies":6390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4086,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'3983","reported_seq":4020,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:51.353893+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:06:51.353893+0000","last_peered":"2024-09-22T03:06:51.353893+0000","last_clean":"2024-09-22T03:06:51.353893+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:06:51.353893+0000","last_undegraded":"2024-09-22T03:06:51.353893+0000","last_fullsized":"2024-09-22T03:06:51.353893+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3983,"log_dups_size":0,"ondisk_log_size":3983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":139853824,"num_objects":2134,"num_object_clones":0,"num_object_copies":6402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3984,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'4119","reported_seq":4156,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:54.351973+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:06:54.351973+0000","last_peered":"2024-09-22T03:06:54.351973+0000","last_clean":"2024-09-22T03:06:54.351973+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:06:54.351973+0000","last_undegraded":"2024-09-22T03:06:54.351973+0000","last_fullsized":"2024-09-22T03:06:54.351973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4119,"log_dups_size":0,"ondisk_log_size":4119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143392768,"num_objects":2188,"num_object_clones":0,"num_object_copies":6564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4120,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'4152","reported_seq":4189,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:54.351514+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:06:54.351514+0000","last_peered":"2024-09-22T03:06:54.351514+0000","last_clean":"2024-09-22T03:06:54.351514+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:06:54.351514+0000","last_undegraded":"2024-09-22T03:06:54.351514+0000","last_fullsized":"2024-09-22T03:06:54.351514+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4152,"log_dups_size":0,"ondisk_log_size":4152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144113664,"num_objects":2199,"num_object_clones":0,"num_object_copies":6597,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4153,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'3970","reported_seq":4007,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:51.313706+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:06:51.313706+0000","last_peered":"2024-09-22T03:06:51.313706+0000","last_clean":"2024-09-22T03:06:51.313706+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:06:51.313706+0000","last_undegraded":"2024-09-22T03:06:51.313706+0000","last_fullsized":"2024-09-22T03:06:51.313706+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3970,"log_dups_size":0,"ondisk_log_size":3970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145293312,"num_objects":2217,"num_object_clones":0,"num_object_copies":6651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3971,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'4068","reported_seq":4105,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:51.325431+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:06:51.325431+0000","last_peered":"2024-09-22T03:06:51.325431+0000","last_clean":"2024-09-22T03:06:51.325431+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:06:51.325431+0000","last_undegraded":"2024-09-22T03:06:51.325431+0000","last_fullsized":"2024-09-22T03:06:51.325431+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4068,"log_dups_size":0,"ondisk_log_size":4068,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143327232,"num_objects":2187,"num_object_clones":0,"num_object_copies":6561,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4069,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'3930","reported_seq":3967,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:51.323212+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:06:51.323212+0000","last_peered":"2024-09-22T03:06:51.323212+0000","last_clean":"2024-09-22T03:06:51.323212+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:06:51.323212+0000","last_undegraded":"2024-09-22T03:06:51.323212+0000","last_fullsized":"2024-09-22T03:06:51.323212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3930,"log_dups_size":0,"ondisk_log_size":3930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142540800,"num_objects":2175,"num_object_clones":0,"num_object_copies":6525,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3931,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4005","reported_seq":4042,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:51.233811+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:06:51.233811+0000","last_peered":"2024-09-22T03:06:51.233811+0000","last_clean":"2024-09-22T03:06:51.233811+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:06:51.233811+0000","last_undegraded":"2024-09-22T03:06:51.233811+0000","last_fullsized":"2024-09-22T03:06:51.233811+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4005,"log_dups_size":0,"ondisk_log_size":4005,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141426688,"num_objects":2158,"num_object_clones":0,"num_object_copies":6474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4006,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'4053","reported_seq":4090,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:51.344991+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:06:51.344991+0000","last_peered":"2024-09-22T03:06:51.344991+0000","last_clean":"2024-09-22T03:06:51.344991+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:06:51.344991+0000","last_undegraded":"2024-09-22T03:06:51.344991+0000","last_fullsized":"2024-09-22T03:06:51.344991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4053,"log_dups_size":0,"ondisk_log_size":4053,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141295616,"num_objects":2156,"num_object_clones":0,"num_object_copies":6468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4054,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'3909","reported_seq":3946,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:51.304768+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:06:51.304768+0000","last_peered":"2024-09-22T03:06:51.304768+0000","last_clean":"2024-09-22T03:06:51.304768+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:06:51.304768+0000","last_undegraded":"2024-09-22T03:06:51.304768+0000","last_fullsized":"2024-09-22T03:06:51.304768+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":3909,"log_dups_size":0,"ondisk_log_size":3909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140902400,"num_objects":2150,"num_object_clones":0,"num_object_copies":6450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3910,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'4070","reported_seq":4107,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:51.206952+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:06:51.206952+0000","last_peered":"2024-09-22T03:06:51.206952+0000","last_clean":"2024-09-22T03:06:51.206952+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:06:51.206952+0000","last_undegraded":"2024-09-22T03:06:51.206952+0000","last_fullsized":"2024-09-22T03:06:51.206952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4070,"log_dups_size":0,"ondisk_log_size":4070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142278656,"num_objects":2171,"num_object_clones":0,"num_object_copies":6513,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4071,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'4003","reported_seq":4040,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:51.118028+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:06:51.118028+0000","last_peered":"2024-09-22T03:06:51.118028+0000","last_clean":"2024-09-22T03:06:51.118028+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:06:51.118028+0000","last_undegraded":"2024-09-22T03:06:51.118028+0000","last_fullsized":"2024-09-22T03:06:51.118028+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4003,"log_dups_size":0,"ondisk_log_size":4003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":141557760,"num_objects":2160,"num_object_clones":0,"num_object_copies":6480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4004,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'4008","reported_seq":4045,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:06:51.368535+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:06:51.368535+0000","last_peered":"2024-09-22T03:06:51.368535+0000","last_clean":"2024-09-22T03:06:51.368535+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:06:51.368535+0000","last_undegraded":"2024-09-22T03:06:51.368535+0000","last_fullsized":"2024-09-22T03:06:51.368535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4008,"log_dups_size":0,"ondisk_log_size":4008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145555456,"num_objects":2221,"num_object_clones":0,"num_object_copies":6663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4009,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2274557976,"num_objects":34708,"num_object_clones":0,"num_object_copies":104124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":64432,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":426831872,"data_stored":6829113416,"data_compressed":324282839,"data_compressed_allocated":426819584,"data_compressed_original":6829113344,"omap_allocated":0,"internal_metadata":0},"log_size":64416,"ondisk_log_size":64416,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":211696,"kb_used_data":122400,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94160144,"statfs":{"total":96636764160,"available":96419987456,"internally_reserved":0,"allocated":125337600,"data_stored":2001996003,"data_compressed":95062262,"data_compressed_allocated":125120512,"data_compressed_original":2001928192,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":164100,"kb_used_data":97008,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94207740,"statfs":{"total":96636764160,"available":96468725760,"internally_reserved":0,"allocated":99336192,"data_stored":1585646315,"data_compressed":75293681,"data_compressed_allocated":99102720,"data_compressed_original":1585561600,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":181196,"kb_used_data":105784,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94190644,"statfs":{"total":96636764160,"available":96451219456,"internally_reserved":0,"allocated":108322816,"data_stored":1729366787,"data_compressed":82118295,"data_compressed_allocated":108085248,"data_compressed_original":1729282048,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":157504,"kb_used_data":94576,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94214336,"statfs":{"total":96636764160,"available":96475480064,"internally_reserved":0,"allocated":96845824,"data_stored":1545800432,"data_compressed":73401583,"data_compressed_allocated":96612352,"data_compressed_original":1545715712,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":96178176,"data_stored":1538785304,"data_compressed":73069757,"data_compressed_allocated":96174080,"data_compressed_original":1538785280,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":107540480,"data_stored":1720582168,"data_compressed":81702445,"data_compressed_allocated":107536384,"data_compressed_original":1720582144,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98557952,"data_stored":1576927232,"data_compressed":74880943,"data_compressed_allocated":98557952,"data_compressed_original":1576927232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":124555264,"data_stored":1992818712,"data_compressed":94629694,"data_compressed_allocated":124551168,"data_compressed_original":1992818688,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:06:55.976 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:06:56.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:56.132+0000 7f50850d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:56.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:56.137+0000 7f50850d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:58.533 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:06:58.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:58.671+0000 7f3b398b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:06:58.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:06:58.677+0000 7f3b398b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:00.784 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:00.784 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:00.784 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:07:00.784 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:07:00.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:00.927+0000 7f4f568fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:00.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:00.940+0000 7f4f568fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:00.988 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:00.988 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:00.988 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:00.988 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:00.988 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:00.988 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:00.988 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:00.988 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:00.988 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:00.988 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:00.988 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:00.989 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:00.991 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:00.991 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:00.991 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:07:01.037 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:01.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:01.133+0000 7f0a456d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:01.146+0000 7f0a456d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:01.177+0000 7f24bd357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:01.184+0000 7f24bd357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.338 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:01.338 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:01.339 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:01.339 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:01.339 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:01.339 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:01.339 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:01.339 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:01.339 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:01.339 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:01.339 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:01.339 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:01.341 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:01.342 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:01.342 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:07:01.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:01.485+0000 7fb138997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:01.499+0000 7fb138997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.535 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:01.536 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:01.536 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:01.536 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:01.536 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:01.536 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:01.536 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:01.536 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:01.536 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:01.536 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:01.536 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:01.536 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:01.539 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:01.540 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:01.540 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:07:01.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:01.685+0000 7fd7b246c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:01.697+0000 7fd7b246c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:01.771 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:01.771 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:01.771 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:01.771 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:01.771 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:01.771 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:01.771 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:01.771 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:01.771 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:01.771 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:01.772 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:01.772 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:01.774 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:01.774 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:03.456 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:03.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:03.590+0000 7f213b058640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:03.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:03.596+0000 7f213b058640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:05.858 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:06.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:05.999+0000 7f03120b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:06.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:06.004+0000 7f03120b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:06.775 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:06.775 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:06.775 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:07:06.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:06.922+0000 7f6ac5d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:06.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:06.930+0000 7f6ac5d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:07.271 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:07:07.272 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:07:07.292 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-09-22T03:07:05.349143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2128872011,"num_objects":32480,"num_object_clones":0,"num_object_copies":97440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":66803,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":66748,"ondisk_log_size":66748,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":695900,"kb_used_data":392852,"kb_used_omap":0,"kb_used_meta":302976,"kb_avail":376791460,"statfs":{"total":386547056640,"available":385834455040,"internally_reserved":0,"allocated":402280448,"data_stored":6421817793,"data_compressed":304935173,"data_compressed_allocated":401358848,"data_compressed_original":6421495808,"omap_allocated":0,"internal_metadata":310247424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-165675008,"num_objects":-2528,"num_object_clones":0,"num_object_copies":-7584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2528,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002202"},"pg_stats":[{"pgid":"3.f","version":"25'4202","reported_seq":4239,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:04.109310+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:07:04.109310+0000","last_peered":"2024-09-22T03:07:04.109310+0000","last_clean":"2024-09-22T03:07:04.109310+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:07:04.109310+0000","last_undegraded":"2024-09-22T03:07:04.109310+0000","last_fullsized":"2024-09-22T03:07:04.109310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4202,"log_dups_size":0,"ondisk_log_size":4202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129171456,"num_objects":1971,"num_object_clones":0,"num_object_copies":5913,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4203,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'4234","reported_seq":4271,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:01.237010+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:07:01.237010+0000","last_peered":"2024-09-22T03:07:01.237010+0000","last_clean":"2024-09-22T03:07:01.237010+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:07:01.237010+0000","last_undegraded":"2024-09-22T03:07:01.237010+0000","last_fullsized":"2024-09-22T03:07:01.237010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4234,"log_dups_size":0,"ondisk_log_size":4234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135069696,"num_objects":2061,"num_object_clones":0,"num_object_copies":6183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4235,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'4059","reported_seq":4097,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:01.323358+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:07:01.323358+0000","last_peered":"2024-09-22T03:07:01.323358+0000","last_clean":"2024-09-22T03:07:01.323358+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:07:01.323358+0000","last_undegraded":"2024-09-22T03:07:01.323358+0000","last_fullsized":"2024-09-22T03:07:01.323358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4059,"log_dups_size":0,"ondisk_log_size":4059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130744344,"num_objects":1996,"num_object_clones":0,"num_object_copies":5988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4060,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'4219","reported_seq":4256,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:04.304724+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:07:04.304724+0000","last_peered":"2024-09-22T03:07:04.304724+0000","last_clean":"2024-09-22T03:07:04.304724+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:07:04.304724+0000","last_undegraded":"2024-09-22T03:07:04.304724+0000","last_fullsized":"2024-09-22T03:07:04.304724+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4219,"log_dups_size":0,"ondisk_log_size":4219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130809856,"num_objects":1996,"num_object_clones":0,"num_object_copies":5988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4220,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'4120","reported_seq":4157,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:01.289907+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:07:01.289907+0000","last_peered":"2024-09-22T03:07:01.289907+0000","last_clean":"2024-09-22T03:07:01.289907+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:07:01.289907+0000","last_undegraded":"2024-09-22T03:07:01.289907+0000","last_fullsized":"2024-09-22T03:07:01.289907+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4120,"log_dups_size":0,"ondisk_log_size":4120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130875392,"num_objects":1997,"num_object_clones":0,"num_object_copies":5991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4121,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'4243","reported_seq":4280,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:04.233289+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:07:04.233289+0000","last_peered":"2024-09-22T03:07:04.233289+0000","last_clean":"2024-09-22T03:07:04.233289+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:07:04.233289+0000","last_undegraded":"2024-09-22T03:07:04.233289+0000","last_fullsized":"2024-09-22T03:07:04.233289+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4243,"log_dups_size":0,"ondisk_log_size":4243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135266304,"num_objects":2064,"num_object_clones":0,"num_object_copies":6192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4244,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'4315","reported_seq":4352,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:04.345471+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:07:04.345471+0000","last_peered":"2024-09-22T03:07:04.345471+0000","last_clean":"2024-09-22T03:07:04.345471+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:07:04.345471+0000","last_undegraded":"2024-09-22T03:07:04.345471+0000","last_fullsized":"2024-09-22T03:07:04.345471+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4315,"log_dups_size":0,"ondisk_log_size":4315,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133431296,"num_objects":2036,"num_object_clones":0,"num_object_copies":6108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4316,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'4107","reported_seq":4144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:01.355111+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:07:01.355111+0000","last_peered":"2024-09-22T03:07:01.355111+0000","last_clean":"2024-09-22T03:07:01.355111+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:07:01.355111+0000","last_undegraded":"2024-09-22T03:07:01.355111+0000","last_fullsized":"2024-09-22T03:07:01.355111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4107,"log_dups_size":0,"ondisk_log_size":4107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136314880,"num_objects":2080,"num_object_clones":0,"num_object_copies":6240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4108,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'4199","reported_seq":4236,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:01.171740+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:07:01.171740+0000","last_peered":"2024-09-22T03:07:01.171740+0000","last_clean":"2024-09-22T03:07:01.171740+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:07:01.171740+0000","last_undegraded":"2024-09-22T03:07:01.171740+0000","last_fullsized":"2024-09-22T03:07:01.171740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":0,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134742016,"num_objects":2056,"num_object_clones":0,"num_object_copies":6168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4200,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'4052","reported_seq":4089,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:01.343240+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:07:01.343240+0000","last_peered":"2024-09-22T03:07:01.343240+0000","last_clean":"2024-09-22T03:07:01.343240+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:07:01.343240+0000","last_undegraded":"2024-09-22T03:07:01.343240+0000","last_fullsized":"2024-09-22T03:07:01.343240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4052,"log_dups_size":0,"ondisk_log_size":4052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134545408,"num_objects":2053,"num_object_clones":0,"num_object_copies":6159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4053,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4165","reported_seq":4202,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:01.274004+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:07:01.274004+0000","last_peered":"2024-09-22T03:07:01.274004+0000","last_clean":"2024-09-22T03:07:01.274004+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:07:01.274004+0000","last_undegraded":"2024-09-22T03:07:01.274004+0000","last_fullsized":"2024-09-22T03:07:01.274004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4165,"log_dups_size":0,"ondisk_log_size":4165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130940928,"num_objects":1998,"num_object_clones":0,"num_object_copies":5994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4166,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'4212","reported_seq":4249,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:01.200891+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:07:01.200891+0000","last_peered":"2024-09-22T03:07:01.200891+0000","last_clean":"2024-09-22T03:07:01.200891+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:07:01.200891+0000","last_undegraded":"2024-09-22T03:07:01.200891+0000","last_fullsized":"2024-09-22T03:07:01.200891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4212,"log_dups_size":0,"ondisk_log_size":4212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130875392,"num_objects":1997,"num_object_clones":0,"num_object_copies":5991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4213,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'4028","reported_seq":4065,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:01.244415+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:07:01.244415+0000","last_peered":"2024-09-22T03:07:01.244415+0000","last_clean":"2024-09-22T03:07:01.244415+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:07:01.244415+0000","last_undegraded":"2024-09-22T03:07:01.244415+0000","last_fullsized":"2024-09-22T03:07:01.244415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4028,"log_dups_size":0,"ondisk_log_size":4028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133103616,"num_objects":2031,"num_object_clones":0,"num_object_copies":6093,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4029,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'4212","reported_seq":4249,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:01.181671+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:07:01.181671+0000","last_peered":"2024-09-22T03:07:01.181671+0000","last_clean":"2024-09-22T03:07:01.181671+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:07:01.181671+0000","last_undegraded":"2024-09-22T03:07:01.181671+0000","last_fullsized":"2024-09-22T03:07:01.181671+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4212,"log_dups_size":0,"ondisk_log_size":4212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132972544,"num_objects":2029,"num_object_clones":0,"num_object_copies":6087,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4213,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'4121","reported_seq":4158,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:01.364646+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:07:01.364646+0000","last_peered":"2024-09-22T03:07:01.364646+0000","last_clean":"2024-09-22T03:07:01.364646+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:07:01.364646+0000","last_undegraded":"2024-09-22T03:07:01.364646+0000","last_fullsized":"2024-09-22T03:07:01.364646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4121,"log_dups_size":0,"ondisk_log_size":4121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":133824512,"num_objects":2042,"num_object_clones":0,"num_object_copies":6126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4122,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'4160","reported_seq":4197,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:01.305608+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:07:01.305608+0000","last_peered":"2024-09-22T03:07:01.305608+0000","last_clean":"2024-09-22T03:07:01.305608+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:07:01.305608+0000","last_undegraded":"2024-09-22T03:07:01.305608+0000","last_fullsized":"2024-09-22T03:07:01.305608+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4160,"log_dups_size":0,"ondisk_log_size":4160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135593984,"num_objects":2069,"num_object_clones":0,"num_object_copies":6207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4161,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2128281624,"num_objects":32476,"num_object_clones":0,"num_object_copies":97428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":66664,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":399519744,"data_stored":6392119368,"data_compressed":303532023,"data_compressed_allocated":399507456,"data_compressed_original":6392119296,"omap_allocated":0,"internal_metadata":0},"log_size":66648,"ondisk_log_size":66648,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":208016,"kb_used_data":114560,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94163824,"statfs":{"total":96636764160,"available":96423755776,"internally_reserved":0,"allocated":117309440,"data_stored":1873545443,"data_compressed":88962742,"data_compressed_allocated":117092352,"data_compressed_original":1873477632,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":162104,"kb_used_data":90852,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94209736,"statfs":{"total":96636764160,"available":96470769664,"internally_reserved":0,"allocated":93032448,"data_stored":1484786411,"data_compressed":70504313,"data_compressed_allocated":92798976,"data_compressed_original":1484701696,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673195,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":165952,"kb_used_data":98860,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94205888,"statfs":{"total":96636764160,"available":96466829312,"internally_reserved":0,"allocated":101232640,"data_stored":1615923971,"data_compressed":76731423,"data_compressed_allocated":100995072,"data_compressed_original":1615839232,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":159828,"kb_used_data":88580,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94212012,"statfs":{"total":96636764160,"available":96473100288,"internally_reserved":0,"allocated":90705920,"data_stored":1447561968,"data_compressed":68736695,"data_compressed_allocated":90472448,"data_compressed_original":1447477248,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":90050560,"data_stored":1440743448,"data_compressed":68414205,"data_compressed_allocated":90046464,"data_compressed_original":1440743424,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":100458496,"data_stored":1607270424,"data_compressed":76321797,"data_compressed_allocated":100454400,"data_compressed_original":1607270400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":92413952,"data_stored":1478623232,"data_compressed":70212943,"data_compressed_allocated":92413952,"data_compressed_original":1478623232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":116596736,"data_stored":1865482264,"data_compressed":88583078,"data_compressed_allocated":116592640,"data_compressed_original":1865482240,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:07:08.298 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:08.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:08.431+0000 7f4a6e623640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:08.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:08.438+0000 7f4a6e623640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:10.767 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:10.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:10.899+0000 7f514a157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:10.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:10.906+0000 7f514a157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:12.293 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:12.294 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:12.294 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:07:12.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:12.447+0000 7f26d866c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:12.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:12.459+0000 7f26d866c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:12.758 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:07:12.759 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:07:12.778 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-22T03:07:11.350241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2059010635,"num_objects":31414,"num_object_clones":0,"num_object_copies":94242,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":67869,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":67814,"ondisk_log_size":67814,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":678880,"kb_used_data":379996,"kb_used_omap":0,"kb_used_meta":298816,"kb_avail":376808480,"statfs":{"total":386547056640,"available":385851883520,"internally_reserved":0,"allocated":389115904,"data_stored":6211185089,"data_compressed":294933205,"data_compressed_allocated":388194304,"data_compressed_original":6210863104,"omap_allocated":0,"internal_metadata":305987584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-162398208,"num_objects":-2478,"num_object_clones":0,"num_object_copies":-7434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2478,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002221"},"pg_stats":[{"pgid":"3.f","version":"25'4262","reported_seq":4299,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:09.314302+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:07:09.314302+0000","last_peered":"2024-09-22T03:07:09.314302+0000","last_clean":"2024-09-22T03:07:09.314302+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:07:09.314302+0000","last_undegraded":"2024-09-22T03:07:09.314302+0000","last_fullsized":"2024-09-22T03:07:09.314302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4262,"log_dups_size":0,"ondisk_log_size":4262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125239296,"num_objects":1911,"num_object_clones":0,"num_object_copies":5733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4263,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'4299","reported_seq":4336,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:06.281546+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:07:06.281546+0000","last_peered":"2024-09-22T03:07:06.281546+0000","last_clean":"2024-09-22T03:07:06.281546+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:07:06.281546+0000","last_undegraded":"2024-09-22T03:07:06.281546+0000","last_fullsized":"2024-09-22T03:07:06.281546+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4299,"log_dups_size":0,"ondisk_log_size":4299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130809856,"num_objects":1996,"num_object_clones":0,"num_object_copies":5988,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4300,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'4140","reported_seq":4178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:06.352409+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:07:06.352409+0000","last_peered":"2024-09-22T03:07:06.352409+0000","last_clean":"2024-09-22T03:07:06.352409+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:07:06.352409+0000","last_undegraded":"2024-09-22T03:07:06.352409+0000","last_fullsized":"2024-09-22T03:07:06.352409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4140,"log_dups_size":0,"ondisk_log_size":4140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125435928,"num_objects":1915,"num_object_clones":0,"num_object_copies":5745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4141,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'4283","reported_seq":4320,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:09.215129+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:07:09.215129+0000","last_peered":"2024-09-22T03:07:09.215129+0000","last_clean":"2024-09-22T03:07:09.215129+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:07:09.215129+0000","last_undegraded":"2024-09-22T03:07:09.215129+0000","last_fullsized":"2024-09-22T03:07:09.215129+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4283,"log_dups_size":0,"ondisk_log_size":4283,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126615552,"num_objects":1932,"num_object_clones":0,"num_object_copies":5796,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4284,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'4188","reported_seq":4225,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:06.261550+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:07:06.261550+0000","last_peered":"2024-09-22T03:07:06.261550+0000","last_clean":"2024-09-22T03:07:06.261550+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:07:06.261550+0000","last_undegraded":"2024-09-22T03:07:06.261550+0000","last_fullsized":"2024-09-22T03:07:06.261550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4188,"log_dups_size":0,"ondisk_log_size":4188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126418944,"num_objects":1929,"num_object_clones":0,"num_object_copies":5787,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4189,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'4312","reported_seq":4349,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:09.235254+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:07:09.235254+0000","last_peered":"2024-09-22T03:07:09.235254+0000","last_clean":"2024-09-22T03:07:09.235254+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:07:09.235254+0000","last_undegraded":"2024-09-22T03:07:09.235254+0000","last_fullsized":"2024-09-22T03:07:09.235254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4312,"log_dups_size":0,"ondisk_log_size":4312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130744320,"num_objects":1995,"num_object_clones":0,"num_object_copies":5985,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4313,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'4382","reported_seq":4419,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:09.266589+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:07:09.266589+0000","last_peered":"2024-09-22T03:07:09.266589+0000","last_clean":"2024-09-22T03:07:09.266589+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:07:09.266589+0000","last_undegraded":"2024-09-22T03:07:09.266589+0000","last_fullsized":"2024-09-22T03:07:09.266589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4382,"log_dups_size":0,"ondisk_log_size":4382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129040384,"num_objects":1969,"num_object_clones":0,"num_object_copies":5907,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4383,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'4190","reported_seq":4227,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:06.229420+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:07:06.229420+0000","last_peered":"2024-09-22T03:07:06.229420+0000","last_clean":"2024-09-22T03:07:06.229420+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:07:06.229420+0000","last_undegraded":"2024-09-22T03:07:06.229420+0000","last_fullsized":"2024-09-22T03:07:06.229420+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4190,"log_dups_size":0,"ondisk_log_size":4190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130875392,"num_objects":1997,"num_object_clones":0,"num_object_copies":5991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4191,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'4243","reported_seq":4280,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:06.261530+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:07:06.261530+0000","last_peered":"2024-09-22T03:07:06.261530+0000","last_clean":"2024-09-22T03:07:06.261530+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:07:06.261530+0000","last_undegraded":"2024-09-22T03:07:06.261530+0000","last_fullsized":"2024-09-22T03:07:06.261530+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4243,"log_dups_size":0,"ondisk_log_size":4243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131858432,"num_objects":2012,"num_object_clones":0,"num_object_copies":6036,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4244,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'4107","reported_seq":4144,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:06.301442+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:07:06.301442+0000","last_peered":"2024-09-22T03:07:06.301442+0000","last_clean":"2024-09-22T03:07:06.301442+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:07:06.301442+0000","last_undegraded":"2024-09-22T03:07:06.301442+0000","last_fullsized":"2024-09-22T03:07:06.301442+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4107,"log_dups_size":0,"ondisk_log_size":4107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130940928,"num_objects":1998,"num_object_clones":0,"num_object_copies":5994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4108,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4236","reported_seq":4273,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:06.048159+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:07:06.048159+0000","last_peered":"2024-09-22T03:07:06.048159+0000","last_clean":"2024-09-22T03:07:06.048159+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:07:06.048159+0000","last_undegraded":"2024-09-22T03:07:06.048159+0000","last_fullsized":"2024-09-22T03:07:06.048159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4236,"log_dups_size":0,"ondisk_log_size":4236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":126287872,"num_objects":1927,"num_object_clones":0,"num_object_copies":5781,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4237,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'4288","reported_seq":4325,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:06.353535+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:07:06.353535+0000","last_peered":"2024-09-22T03:07:06.353535+0000","last_clean":"2024-09-22T03:07:06.353535+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:07:06.353535+0000","last_undegraded":"2024-09-22T03:07:06.353535+0000","last_fullsized":"2024-09-22T03:07:06.353535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4288,"log_dups_size":0,"ondisk_log_size":4288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125894656,"num_objects":1921,"num_object_clones":0,"num_object_copies":5763,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4289,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'4089","reported_seq":4126,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:06.266794+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:07:06.266794+0000","last_peered":"2024-09-22T03:07:06.266794+0000","last_clean":"2024-09-22T03:07:06.266794+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:07:06.266794+0000","last_undegraded":"2024-09-22T03:07:06.266794+0000","last_fullsized":"2024-09-22T03:07:06.266794+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4089,"log_dups_size":0,"ondisk_log_size":4089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129105920,"num_objects":1970,"num_object_clones":0,"num_object_copies":5910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4090,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'4274","reported_seq":4311,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:06.345118+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:07:06.345118+0000","last_peered":"2024-09-22T03:07:06.345118+0000","last_clean":"2024-09-22T03:07:06.345118+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:07:06.345118+0000","last_undegraded":"2024-09-22T03:07:06.345118+0000","last_fullsized":"2024-09-22T03:07:06.345118+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4274,"log_dups_size":0,"ondisk_log_size":4274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":128909312,"num_objects":1967,"num_object_clones":0,"num_object_copies":5901,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4275,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'4189","reported_seq":4226,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:06.386001+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:07:06.386001+0000","last_peered":"2024-09-22T03:07:06.386001+0000","last_clean":"2024-09-22T03:07:06.386001+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:07:06.386001+0000","last_undegraded":"2024-09-22T03:07:06.386001+0000","last_fullsized":"2024-09-22T03:07:06.386001+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":0,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":129368064,"num_objects":1974,"num_object_clones":0,"num_object_copies":5922,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4190,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'4232","reported_seq":4269,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:06.162534+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:07:06.162534+0000","last_peered":"2024-09-22T03:07:06.162534+0000","last_clean":"2024-09-22T03:07:06.162534+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:07:06.162534+0000","last_undegraded":"2024-09-22T03:07:06.162534+0000","last_fullsized":"2024-09-22T03:07:06.162534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4232,"log_dups_size":0,"ondisk_log_size":4232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130875392,"num_objects":1997,"num_object_clones":0,"num_object_copies":5991,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4233,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":2058420248,"num_objects":31410,"num_object_clones":0,"num_object_copies":94230,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":67730,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":386326528,"data_stored":6181027912,"data_compressed":293508271,"data_compressed_allocated":386314240,"data_compressed_original":6181027840,"omap_allocated":0,"internal_metadata":0},"log_size":67714,"ondisk_log_size":67714,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":191828,"kb_used_data":110852,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94180012,"statfs":{"total":96636764160,"available":96440332288,"internally_reserved":0,"allocated":113512448,"data_stored":1812793571,"data_compressed":86077918,"data_compressed_allocated":113295360,"data_compressed_original":1812725760,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":163272,"kb_used_data":87864,"kb_used_omap":0,"kb_used_meta":75392,"kb_avail":94208568,"statfs":{"total":96636764160,"available":96469573632,"internally_reserved":0,"allocated":89972736,"data_stored":1435831019,"data_compressed":68179649,"data_compressed_allocated":89739264,"data_compressed_original":1435746304,"omap_allocated":0,"internal_metadata":77201408},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673200,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":166800,"kb_used_data":95552,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94205040,"statfs":{"total":96636764160,"available":96465960960,"internally_reserved":0,"allocated":97845248,"data_stored":1561725699,"data_compressed":74157799,"data_compressed_allocated":97607680,"data_compressed_original":1561640960,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705908,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":156980,"kb_used_data":85728,"kb_used_omap":0,"kb_used_meta":71232,"kb_avail":94214860,"statfs":{"total":96636764160,"available":96476016640,"internally_reserved":0,"allocated":87785472,"data_stored":1400834800,"data_compressed":66517839,"data_compressed_allocated":87552000,"data_compressed_original":1400750080,"omap_allocated":0,"internal_metadata":72941568},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":87121920,"data_stored":1393885208,"data_compressed":66189125,"data_compressed_allocated":87117824,"data_compressed_original":1393885184,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":97091584,"data_stored":1553399832,"data_compressed":73763733,"data_compressed_allocated":97087488,"data_compressed_original":1553399808,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":89309184,"data_stored":1428946944,"data_compressed":67854047,"data_compressed_allocated":89309184,"data_compressed_original":1428946944,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":112803840,"data_stored":1804795928,"data_compressed":85701366,"data_compressed_allocated":112799744,"data_compressed_original":1804795904,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:07:13.269 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:13.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:13.408+0000 7f52f2b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:13.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:13.415+0000 7f52f2b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:15.852 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:15.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:15.993+0000 7faf22797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:16.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:15.999+0000 7faf22797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:17.780 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:17.780 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:17.781 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:07:17.781 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:07:17.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:17.922+0000 7f5899397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:17.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:17.933+0000 7f5899397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:18.004 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:18.004 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:18.004 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:18.004 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:18.004 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:18.004 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:18.004 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:18.004 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:18.004 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:18.004 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:18.004 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:18.004 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:18.007 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:18.008 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:18.008 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:07:18.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:18.156+0000 7f4954117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:18.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:18.165+0000 7f4954117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:18.198 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:18.198 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:18.198 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:18.199 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:18.199 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:18.199 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:18.199 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:18.199 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:18.199 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:18.199 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:18.199 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:18.199 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:18.202 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:18.203 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:18.203 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:07:18.343 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:18.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:18.358+0000 7ff5bb957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:18.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:18.371+0000 7ff5bb957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:18.409 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:18.410 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:18.410 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:18.410 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:18.410 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:18.410 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:18.410 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:18.410 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:18.410 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:18.410 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:18.410 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:18.410 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:18.415 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:18.416 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:18.416 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:07:18.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:18.481+0000 7fda29818640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:18.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:18.489+0000 7fda29818640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:18.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:18.591+0000 7fa5d4797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:18.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:18.605+0000 7fa5d4797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:18.637 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:18.638 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:18.638 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:18.638 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:18.638 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:18.638 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:18.638 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:18.638 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:18.638 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:18.638 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:18.638 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:18.638 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:18.641 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:18.641 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:20.807 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:20.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:20.951+0000 7f1499c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:20.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:20.959+0000 7f1499c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:23.322 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:23.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:23.470+0000 7f83a8c18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:23.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:23.476+0000 7f83a8c18640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:23.643 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:23.643 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:23.643 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:07:23.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:23.778+0000 7f942f22c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:23.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:23.791+0000 7f942f22c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:24.069 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:07:24.070 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:07:24.085 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-09-22T03:07:23.352242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1869087307,"num_objects":28516,"num_object_clones":0,"num_object_copies":85548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":70767,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70712,"ondisk_log_size":70712,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":630868,"kb_used_data":344460,"kb_used_omap":0,"kb_used_meta":286336,"kb_avail":376856492,"statfs":{"total":386547056640,"available":385901047808,"internally_reserved":0,"allocated":352727040,"data_stored":5628963265,"data_compressed":267286197,"data_compressed_allocated":351805440,"data_compressed_original":5628641280,"omap_allocated":0,"internal_metadata":293208064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-189923328,"num_objects":-2898,"num_object_clones":0,"num_object_copies":-8694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2898,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002001"},"pg_stats":[{"pgid":"3.f","version":"25'4409","reported_seq":4446,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:19.337558+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:07:19.337558+0000","last_peered":"2024-09-22T03:07:19.337558+0000","last_clean":"2024-09-22T03:07:19.337558+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:07:19.337558+0000","last_undegraded":"2024-09-22T03:07:19.337558+0000","last_fullsized":"2024-09-22T03:07:19.337558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4409,"log_dups_size":0,"ondisk_log_size":4409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115605504,"num_objects":1764,"num_object_clones":0,"num_object_copies":5292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4410,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'4503","reported_seq":4540,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.193433+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:07:21.193433+0000","last_peered":"2024-09-22T03:07:21.193433+0000","last_clean":"2024-09-22T03:07:21.193433+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:07:21.193433+0000","last_undegraded":"2024-09-22T03:07:21.193433+0000","last_fullsized":"2024-09-22T03:07:21.193433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4503,"log_dups_size":0,"ondisk_log_size":4503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":1792,"num_object_clones":0,"num_object_copies":5376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4504,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'4325","reported_seq":4363,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.361675+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:07:21.361675+0000","last_peered":"2024-09-22T03:07:21.361675+0000","last_clean":"2024-09-22T03:07:21.361675+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:07:21.361675+0000","last_undegraded":"2024-09-22T03:07:21.361675+0000","last_fullsized":"2024-09-22T03:07:21.361675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4325,"log_dups_size":0,"ondisk_log_size":4325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113311768,"num_objects":1730,"num_object_clones":0,"num_object_copies":5190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4326,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'4402","reported_seq":4439,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:19.297467+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:07:19.297467+0000","last_peered":"2024-09-22T03:07:19.297467+0000","last_clean":"2024-09-22T03:07:19.297467+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:07:19.297467+0000","last_undegraded":"2024-09-22T03:07:19.297467+0000","last_fullsized":"2024-09-22T03:07:19.297467+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4402,"log_dups_size":0,"ondisk_log_size":4402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118816768,"num_objects":1813,"num_object_clones":0,"num_object_copies":5439,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4403,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'4372","reported_seq":4409,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.119631+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:07:21.119631+0000","last_peered":"2024-09-22T03:07:21.119631+0000","last_clean":"2024-09-22T03:07:21.119631+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:07:21.119631+0000","last_undegraded":"2024-09-22T03:07:21.119631+0000","last_fullsized":"2024-09-22T03:07:21.119631+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4372,"log_dups_size":0,"ondisk_log_size":4372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114360320,"num_objects":1745,"num_object_clones":0,"num_object_copies":5235,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4373,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'4444","reported_seq":4481,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:19.189755+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:07:19.189755+0000","last_peered":"2024-09-22T03:07:19.189755+0000","last_clean":"2024-09-22T03:07:19.189755+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:07:19.189755+0000","last_undegraded":"2024-09-22T03:07:19.189755+0000","last_fullsized":"2024-09-22T03:07:19.189755+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4444,"log_dups_size":0,"ondisk_log_size":4444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":122093568,"num_objects":1863,"num_object_clones":0,"num_object_copies":5589,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4445,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'4511","reported_seq":4548,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:19.248192+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:07:19.248192+0000","last_peered":"2024-09-22T03:07:19.248192+0000","last_clean":"2024-09-22T03:07:19.248192+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:07:19.248192+0000","last_undegraded":"2024-09-22T03:07:19.248192+0000","last_fullsized":"2024-09-22T03:07:19.248192+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":0,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120586240,"num_objects":1840,"num_object_clones":0,"num_object_copies":5520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4512,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'4375","reported_seq":4412,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.084177+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:07:21.084177+0000","last_peered":"2024-09-22T03:07:21.084177+0000","last_clean":"2024-09-22T03:07:21.084177+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:07:21.084177+0000","last_undegraded":"2024-09-22T03:07:21.084177+0000","last_fullsized":"2024-09-22T03:07:21.084177+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4375,"log_dups_size":0,"ondisk_log_size":4375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118751232,"num_objects":1812,"num_object_clones":0,"num_object_copies":5436,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4376,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'4468","reported_seq":4505,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.349506+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:07:21.349506+0000","last_peered":"2024-09-22T03:07:21.349506+0000","last_clean":"2024-09-22T03:07:21.349506+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:07:21.349506+0000","last_undegraded":"2024-09-22T03:07:21.349506+0000","last_fullsized":"2024-09-22T03:07:21.349506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4468,"log_dups_size":0,"ondisk_log_size":4468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117112832,"num_objects":1787,"num_object_clones":0,"num_object_copies":5361,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4469,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'4270","reported_seq":4307,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.182502+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:07:21.182502+0000","last_peered":"2024-09-22T03:07:21.182502+0000","last_clean":"2024-09-22T03:07:21.182502+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:07:21.182502+0000","last_undegraded":"2024-09-22T03:07:21.182502+0000","last_fullsized":"2024-09-22T03:07:21.182502+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4270,"log_dups_size":0,"ondisk_log_size":4270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120258560,"num_objects":1835,"num_object_clones":0,"num_object_copies":5505,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4271,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4431","reported_seq":4468,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.271884+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:07:21.271884+0000","last_peered":"2024-09-22T03:07:21.271884+0000","last_clean":"2024-09-22T03:07:21.271884+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:07:21.271884+0000","last_undegraded":"2024-09-22T03:07:21.271884+0000","last_fullsized":"2024-09-22T03:07:21.271884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4431,"log_dups_size":0,"ondisk_log_size":4431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113508352,"num_objects":1732,"num_object_clones":0,"num_object_copies":5196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4432,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'4519","reported_seq":4556,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.286995+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:07:21.286995+0000","last_peered":"2024-09-22T03:07:21.286995+0000","last_clean":"2024-09-22T03:07:21.286995+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:07:21.286995+0000","last_undegraded":"2024-09-22T03:07:21.286995+0000","last_fullsized":"2024-09-22T03:07:21.286995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4519,"log_dups_size":0,"ondisk_log_size":4519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110755840,"num_objects":1690,"num_object_clones":0,"num_object_copies":5070,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4520,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'4304","reported_seq":4341,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.220317+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:07:21.220317+0000","last_peered":"2024-09-22T03:07:21.220317+0000","last_clean":"2024-09-22T03:07:21.220317+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:07:21.220317+0000","last_undegraded":"2024-09-22T03:07:21.220317+0000","last_fullsized":"2024-09-22T03:07:21.220317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4304,"log_dups_size":0,"ondisk_log_size":4304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115015680,"num_objects":1755,"num_object_clones":0,"num_object_copies":5265,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4305,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'4483","reported_seq":4520,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.351120+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:07:21.351120+0000","last_peered":"2024-09-22T03:07:21.351120+0000","last_clean":"2024-09-22T03:07:21.351120+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:07:21.351120+0000","last_undegraded":"2024-09-22T03:07:21.351120+0000","last_fullsized":"2024-09-22T03:07:21.351120+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4483,"log_dups_size":0,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115212288,"num_objects":1758,"num_object_clones":0,"num_object_copies":5274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4484,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'4368","reported_seq":4405,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.272160+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:07:21.272160+0000","last_peered":"2024-09-22T03:07:21.272160+0000","last_clean":"2024-09-22T03:07:21.272160+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:07:21.272160+0000","last_undegraded":"2024-09-22T03:07:21.272160+0000","last_fullsized":"2024-09-22T03:07:21.272160+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4368,"log_dups_size":0,"ondisk_log_size":4368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117637120,"num_objects":1795,"num_object_clones":0,"num_object_copies":5385,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4369,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'4428","reported_seq":4465,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:21.180537+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:07:21.180537+0000","last_peered":"2024-09-22T03:07:21.180537+0000","last_clean":"2024-09-22T03:07:21.180537+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:07:21.180537+0000","last_undegraded":"2024-09-22T03:07:21.180537+0000","last_fullsized":"2024-09-22T03:07:21.180537+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4428,"log_dups_size":0,"ondisk_log_size":4428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":118030336,"num_objects":1801,"num_object_clones":0,"num_object_copies":5403,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4429,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1868496920,"num_objects":28512,"num_object_clones":0,"num_object_copies":85536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":70628,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":350154752,"data_stored":5602279496,"data_compressed":266026199,"data_compressed_allocated":350142464,"data_compressed_original":5602279424,"omap_allocated":0,"internal_metadata":0},"log_size":70612,"ondisk_log_size":70612,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673215,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":193112,"kb_used_data":99652,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94178728,"statfs":{"total":96636764160,"available":96439017472,"internally_reserved":0,"allocated":102043648,"data_stored":1629292771,"data_compressed":77364318,"data_compressed_allocated":101826560,"data_compressed_original":1629224960,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673215,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":146460,"kb_used_data":79368,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94225380,"statfs":{"total":96636764160,"available":96486789120,"internally_reserved":0,"allocated":81272832,"data_stored":1296632555,"data_compressed":61569761,"data_compressed_allocated":81039360,"data_compressed_original":1296547840,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673215,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":148560,"kb_used_data":85632,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94223280,"statfs":{"total":96636764160,"available":96484638720,"internally_reserved":0,"allocated":87687168,"data_stored":1399196419,"data_compressed":66440039,"data_compressed_allocated":87449600,"data_compressed_original":1399111680,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":142736,"kb_used_data":79808,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94229104,"statfs":{"total":96636764160,"available":96490602496,"internally_reserved":0,"allocated":81723392,"data_stored":1303841520,"data_compressed":61912079,"data_compressed_allocated":81489920,"data_compressed_original":1303756800,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":81113088,"data_stored":1297743896,"data_compressed":61623821,"data_compressed_allocated":81108992,"data_compressed_original":1297743872,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86949888,"data_stored":1391132696,"data_compressed":66058421,"data_compressed_allocated":86945792,"data_compressed_original":1391132672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":80691200,"data_stored":1291059200,"data_compressed":61306399,"data_compressed_allocated":80691200,"data_compressed_original":1291059200,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":101400576,"data_stored":1622343704,"data_compressed":77037558,"data_compressed_allocated":101396480,"data_compressed_original":1622343680,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:07:25.754 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:25.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:25.896+0000 7fed48ece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:25.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:25.902+0000 7fed48ece640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:28.429 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:28.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:28.567+0000 7f286ab57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:28.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:28.574+0000 7f286ab57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:29.088 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:29.088 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:29.088 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:07:29.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:29.212+0000 7f50e290e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:29.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:29.221+0000 7f50e290e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:29.556 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:07:29.556 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:07:29.571 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-22T03:07:29.353384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1799619147,"num_objects":27456,"num_object_clones":0,"num_object_copies":82368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":71827,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71772,"ondisk_log_size":71772,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":614288,"kb_used_data":332024,"kb_used_omap":0,"kb_used_meta":282176,"kb_avail":376873072,"statfs":{"total":386547056640,"available":385918025728,"internally_reserved":0,"allocated":339992576,"data_stored":5425211841,"data_compressed":257610989,"data_compressed_allocated":339070976,"data_compressed_original":5424889856,"omap_allocated":0,"internal_metadata":288948224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-137232384,"num_objects":-2094,"num_object_clones":0,"num_object_copies":-6282,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2094,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002163"},"pg_stats":[{"pgid":"3.f","version":"25'4476","reported_seq":4513,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:24.302007+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:07:24.302007+0000","last_peered":"2024-09-22T03:07:24.302007+0000","last_clean":"2024-09-22T03:07:24.302007+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:07:24.302007+0000","last_undegraded":"2024-09-22T03:07:24.302007+0000","last_fullsized":"2024-09-22T03:07:24.302007+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111214592,"num_objects":1697,"num_object_clones":0,"num_object_copies":5091,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4477,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'4565","reported_seq":4602,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:26.239116+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:07:26.239116+0000","last_peered":"2024-09-22T03:07:26.239116+0000","last_clean":"2024-09-22T03:07:26.239116+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:07:26.239116+0000","last_undegraded":"2024-09-22T03:07:26.239116+0000","last_fullsized":"2024-09-22T03:07:26.239116+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4565,"log_dups_size":0,"ondisk_log_size":4565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113377280,"num_objects":1730,"num_object_clones":0,"num_object_copies":5190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4566,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'4381","reported_seq":4419,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:26.183127+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:07:26.183127+0000","last_peered":"2024-09-22T03:07:26.183127+0000","last_clean":"2024-09-22T03:07:26.183127+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:07:26.183127+0000","last_undegraded":"2024-09-22T03:07:26.183127+0000","last_fullsized":"2024-09-22T03:07:26.183127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4381,"log_dups_size":0,"ondisk_log_size":4381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109641752,"num_objects":1674,"num_object_clones":0,"num_object_copies":5022,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4382,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'4468","reported_seq":4505,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:24.359653+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:07:24.359653+0000","last_peered":"2024-09-22T03:07:24.359653+0000","last_clean":"2024-09-22T03:07:24.359653+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:07:24.359653+0000","last_undegraded":"2024-09-22T03:07:24.359653+0000","last_fullsized":"2024-09-22T03:07:24.359653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4468,"log_dups_size":0,"ondisk_log_size":4468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114491392,"num_objects":1747,"num_object_clones":0,"num_object_copies":5241,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4469,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'4431","reported_seq":4468,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:26.090223+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:07:26.090223+0000","last_peered":"2024-09-22T03:07:26.090223+0000","last_clean":"2024-09-22T03:07:26.090223+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:07:26.090223+0000","last_undegraded":"2024-09-22T03:07:26.090223+0000","last_fullsized":"2024-09-22T03:07:26.090223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4431,"log_dups_size":0,"ondisk_log_size":4431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110493696,"num_objects":1686,"num_object_clones":0,"num_object_copies":5058,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4432,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'4509","reported_seq":4546,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:24.285292+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:07:24.285292+0000","last_peered":"2024-09-22T03:07:24.285292+0000","last_clean":"2024-09-22T03:07:24.285292+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:07:24.285292+0000","last_undegraded":"2024-09-22T03:07:24.285292+0000","last_fullsized":"2024-09-22T03:07:24.285292+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4509,"log_dups_size":0,"ondisk_log_size":4509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117833728,"num_objects":1798,"num_object_clones":0,"num_object_copies":5394,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4510,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'4578","reported_seq":4615,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:24.308649+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:07:24.308649+0000","last_peered":"2024-09-22T03:07:24.308649+0000","last_clean":"2024-09-22T03:07:24.308649+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:07:24.308649+0000","last_undegraded":"2024-09-22T03:07:24.308649+0000","last_fullsized":"2024-09-22T03:07:24.308649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4578,"log_dups_size":0,"ondisk_log_size":4578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116195328,"num_objects":1773,"num_object_clones":0,"num_object_copies":5319,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4579,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'4447","reported_seq":4484,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:26.300287+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:07:26.300287+0000","last_peered":"2024-09-22T03:07:26.300287+0000","last_clean":"2024-09-22T03:07:26.300287+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:07:26.300287+0000","last_undegraded":"2024-09-22T03:07:26.300287+0000","last_fullsized":"2024-09-22T03:07:26.300287+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4447,"log_dups_size":0,"ondisk_log_size":4447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114032640,"num_objects":1740,"num_object_clones":0,"num_object_copies":5220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4448,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'4550","reported_seq":4587,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:26.228329+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:07:26.228329+0000","last_peered":"2024-09-22T03:07:26.228329+0000","last_clean":"2024-09-22T03:07:26.228329+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:07:26.228329+0000","last_undegraded":"2024-09-22T03:07:26.228329+0000","last_fullsized":"2024-09-22T03:07:26.228329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4550,"log_dups_size":0,"ondisk_log_size":4550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111738880,"num_objects":1705,"num_object_clones":0,"num_object_copies":5115,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4551,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'4342","reported_seq":4379,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:26.279927+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:07:26.279927+0000","last_peered":"2024-09-22T03:07:26.279927+0000","last_clean":"2024-09-22T03:07:26.279927+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:07:26.279927+0000","last_undegraded":"2024-09-22T03:07:26.279927+0000","last_fullsized":"2024-09-22T03:07:26.279927+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4342,"log_dups_size":0,"ondisk_log_size":4342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115539968,"num_objects":1763,"num_object_clones":0,"num_object_copies":5289,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4343,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4497","reported_seq":4534,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:26.180557+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:07:26.180557+0000","last_peered":"2024-09-22T03:07:26.180557+0000","last_clean":"2024-09-22T03:07:26.180557+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:07:26.180557+0000","last_undegraded":"2024-09-22T03:07:26.180557+0000","last_fullsized":"2024-09-22T03:07:26.180557+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":0,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109182976,"num_objects":1666,"num_object_clones":0,"num_object_copies":4998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4498,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'4583","reported_seq":4620,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:26.154543+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:07:26.154543+0000","last_peered":"2024-09-22T03:07:26.154543+0000","last_clean":"2024-09-22T03:07:26.154543+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:07:26.154543+0000","last_undegraded":"2024-09-22T03:07:26.154543+0000","last_fullsized":"2024-09-22T03:07:26.154543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4583,"log_dups_size":0,"ondisk_log_size":4583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106561536,"num_objects":1626,"num_object_clones":0,"num_object_copies":4878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4584,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'4372","reported_seq":4409,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:26.307935+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:07:26.307935+0000","last_peered":"2024-09-22T03:07:26.307935+0000","last_clean":"2024-09-22T03:07:26.307935+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:07:26.307935+0000","last_undegraded":"2024-09-22T03:07:26.307935+0000","last_fullsized":"2024-09-22T03:07:26.307935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4372,"log_dups_size":0,"ondisk_log_size":4372,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110559232,"num_objects":1687,"num_object_clones":0,"num_object_copies":5061,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4373,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'4547","reported_seq":4584,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:26.324141+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:07:26.324141+0000","last_peered":"2024-09-22T03:07:26.324141+0000","last_clean":"2024-09-22T03:07:26.324141+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:07:26.324141+0000","last_undegraded":"2024-09-22T03:07:26.324141+0000","last_fullsized":"2024-09-22T03:07:26.324141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4547,"log_dups_size":0,"ondisk_log_size":4547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111017984,"num_objects":1694,"num_object_clones":0,"num_object_copies":5082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4548,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'4440","reported_seq":4477,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:26.180332+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:07:26.180332+0000","last_peered":"2024-09-22T03:07:26.180332+0000","last_clean":"2024-09-22T03:07:26.180332+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:07:26.180332+0000","last_undegraded":"2024-09-22T03:07:26.180332+0000","last_fullsized":"2024-09-22T03:07:26.180332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4440,"log_dups_size":0,"ondisk_log_size":4440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112918528,"num_objects":1723,"num_object_clones":0,"num_object_copies":5169,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4441,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'4486","reported_seq":4523,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:26.307319+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:07:26.307319+0000","last_peered":"2024-09-22T03:07:26.307319+0000","last_clean":"2024-09-22T03:07:26.307319+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:07:26.307319+0000","last_undegraded":"2024-09-22T03:07:26.307319+0000","last_fullsized":"2024-09-22T03:07:26.307319+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4486,"log_dups_size":0,"ondisk_log_size":4486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":114229248,"num_objects":1743,"num_object_clones":0,"num_object_copies":5229,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4487,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1799028760,"num_objects":27452,"num_object_clones":0,"num_object_copies":82356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":71688,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":337215488,"data_stored":5395251272,"data_compressed":256195393,"data_compressed_allocated":337203200,"data_compressed_original":5395251200,"omap_allocated":0,"internal_metadata":0},"log_size":71672,"ondisk_log_size":71672,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":176960,"kb_used_data":95972,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94194880,"statfs":{"total":96636764160,"available":96455557120,"internally_reserved":0,"allocated":98275328,"data_stored":1568999651,"data_compressed":74501278,"data_compressed_allocated":98058240,"data_compressed_original":1568931840,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":143644,"kb_used_data":76548,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94228196,"statfs":{"total":96636764160,"available":96489672704,"internally_reserved":0,"allocated":78385152,"data_stored":1250429675,"data_compressed":59375801,"data_compressed_allocated":78151680,"data_compressed_original":1250344960,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":149644,"kb_used_data":82556,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94222196,"statfs":{"total":96636764160,"available":96483528704,"internally_reserved":0,"allocated":84537344,"data_stored":1348799235,"data_compressed":64046911,"data_compressed_allocated":84299776,"data_compressed_original":1348714496,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":144040,"kb_used_data":76948,"kb_used_omap":0,"kb_used_meta":67072,"kb_avail":94227800,"statfs":{"total":96636764160,"available":96489267200,"internally_reserved":0,"allocated":78794752,"data_stored":1256983280,"data_compressed":59686999,"data_compressed_allocated":78561280,"data_compressed_original":1256898560,"omap_allocated":0,"internal_metadata":68681728},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":78118912,"data_stored":1249837080,"data_compressed":59348949,"data_compressed_allocated":78114816,"data_compressed_original":1249837056,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":83775488,"data_stored":1340342296,"data_compressed":63646622,"data_compressed_allocated":83771392,"data_compressed_original":1340342272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77713408,"data_stored":1243414528,"data_compressed":59043975,"data_compressed_allocated":77713408,"data_compressed_original":1243414528,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97607680,"data_stored":1561657368,"data_compressed":74155847,"data_compressed_allocated":97603584,"data_compressed_original":1561657344,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:07:30.851 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:30.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:30.988+0000 7f41e604f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:30.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:30.994+0000 7f41e604f640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:33.290 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:33.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:33.438+0000 7fda28cce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:33.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:33.446+0000 7fda28cce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:34.574 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:34.574 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:34.574 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:07:34.575 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:07:34.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:34.712+0000 7f17c422c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:34.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:34.721+0000 7f17c422c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:34.822 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:34.822 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:34.822 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:34.823 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:34.823 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:34.823 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:34.823 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:34.823 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:34.823 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:34.823 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:34.823 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:34.823 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:34.826 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:34.827 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:34.827 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:07:34.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:34.965+0000 7f30aac63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:34.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:34.976+0000 7f30aac63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:35.089 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:35.089 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:35.089 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:35.089 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:35.089 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:35.089 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:35.089 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:35.089 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:35.090 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:35.090 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:35.090 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:35.090 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:35.093 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:35.093 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:35.093 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:07:35.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:35.237+0000 7ff1f8cd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:35.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:35.254+0000 7ff1f8cd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:35.274 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:35.275 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:35.275 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:35.276 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:35.276 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:35.276 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:35.276 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:35.276 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:35.276 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:35.276 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:35.276 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:35.276 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:35.279 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:35.280 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:35.281 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:07:35.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:35.415+0000 7f165282c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:35.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:35.430+0000 7f165282c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:35.517 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:35.518 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:35.518 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:35.518 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:35.518 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:35.518 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:35.518 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:35.519 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:35.519 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:35.519 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:35.519 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:35.519 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:35.523 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:35.523 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:36.053 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:36.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:36.201+0000 7fe2c6d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:36.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:36.209+0000 7fe2c6d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:38.488 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:38.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:38.639+0000 7f5d0d2b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:38.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:38.646+0000 7f5d0d2b2640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:40.524 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:40.525 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:40.525 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:07:40.525 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:07:40.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:40.645+0000 7f1e31afa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:40.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:40.671+0000 7f1e31afa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:40.705 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:40.705 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:40.705 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:40.705 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:40.705 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:40.705 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:40.705 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:40.705 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:40.706 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:40.706 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:40.706 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:40.706 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:40.709 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:40.709 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:40.709 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:07:40.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:40.850+0000 7f67b1157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:40.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:40.859+0000 7f67b1157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:41.017 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:41.017 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:41.018 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:41.018 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:41.018 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:41.018 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:41.018 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:41.018 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:41.018 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:41.018 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:41.018 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:41.018 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:41.021 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:41.021 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:41.021 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:07:41.037 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:41.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:41.147+0000 7f86e4197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:41.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:41.159+0000 7f86e4197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:41.201 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:41.201 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:41.201 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:41.201 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:41.201 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:41.202 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:41.202 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:41.202 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:41.202 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:41.202 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:41.202 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:41.202 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:41.205 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:41.205 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:41.205 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:07:41.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:41.209+0000 7f82eab17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:41.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:41.216+0000 7f82eab17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:41.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:41.351+0000 7f3fcb997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:41.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:41.360+0000 7f3fcb997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:41.392 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:41.392 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:41.392 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:41.393 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:41.393 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:41.393 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:41.393 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:41.393 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:41.393 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:41.393 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:41.393 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:41.393 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:41.396 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:41.397 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:43.457 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:43.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:43.594+0000 7fd250757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:43.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:43.600+0000 7fd250757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:46.072 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:46.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:46.196+0000 7f18ff8d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:46.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:46.205+0000 7f18ff8d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:46.398 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:46.398 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:46.398 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:07:46.398 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:07:46.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:46.542+0000 7fcb3022c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:46.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:46.557+0000 7fcb3022c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:46.580 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:46.581 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:46.582 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:46.582 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:46.582 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:46.582 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:46.582 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:46.582 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:46.582 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:46.582 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:46.583 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:46.583 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:46.589 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:46.589 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:46.589 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:07:46.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:46.739+0000 7f056bf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:46.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:46.748+0000 7f056bf97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:46.765 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:46.766 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:46.766 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:46.766 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:46.766 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:46.766 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:46.766 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:46.766 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:46.766 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:46.766 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:46.766 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:46.766 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:46.768 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:46.769 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:46.769 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:07:46.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:46.909+0000 7fd3c6757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:46.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:46.921+0000 7fd3c6757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:47.002 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:47.002 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:47.002 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:47.003 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:47.003 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:47.003 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:47.003 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:47.003 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:47.003 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:47.003 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:47.003 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:47.003 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:47.006 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:47.007 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:47.007 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:07:47.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:47.137+0000 7f2603ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:47.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:47.151+0000 7f2603ed7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:47.170 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:47.170 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:47.170 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:47.171 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:47.171 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:47.171 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:47.171 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:47.171 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:47.171 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:47.171 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:47.171 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:47.171 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:47.174 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:47.175 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:48.589 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:48.715+0000 7f1905c58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:48.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:48.721+0000 7f1905c58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:51.102 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:51.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:51.237+0000 7faeeff57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:51.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:51.244+0000 7faeeff57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:52.176 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:52.176 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:52.176 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:07:52.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:52.319+0000 7f4fcb197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:52.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:52.332+0000 7f4fcb197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:52.618 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:07:52.619 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:07:52.633 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-22T03:07:51.357407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1512243787,"num_objects":23071,"num_object_clones":0,"num_object_copies":69213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":76212,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76157,"ondisk_log_size":76157,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":579888,"kb_used_data":279592,"kb_used_omap":0,"kb_used_meta":300224,"kb_avail":376907472,"statfs":{"total":386547056640,"available":385953251328,"internally_reserved":0,"allocated":286302208,"data_stored":4566165953,"data_compressed":216818896,"data_compressed_allocated":285380608,"data_compressed_original":4565843968,"omap_allocated":0,"internal_metadata":307429376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-150929408,"num_objects":-2303,"num_object_clones":0,"num_object_copies":-6909,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2303,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002189"},"pg_stats":[{"pgid":"3.f","version":"25'4792","reported_seq":4829,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:49.113623+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:07:49.113623+0000","last_peered":"2024-09-22T03:07:49.113623+0000","last_clean":"2024-09-22T03:07:49.113623+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:07:49.113623+0000","last_undegraded":"2024-09-22T03:07:49.113623+0000","last_fullsized":"2024-09-22T03:07:49.113623+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4792,"log_dups_size":0,"ondisk_log_size":4792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90505216,"num_objects":1381,"num_object_clones":0,"num_object_copies":4143,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4793,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'4836","reported_seq":4873,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.265123+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:07:46.265123+0000","last_peered":"2024-09-22T03:07:46.265123+0000","last_clean":"2024-09-22T03:07:46.265123+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:07:46.265123+0000","last_undegraded":"2024-09-22T03:07:46.265123+0000","last_fullsized":"2024-09-22T03:07:46.265123+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4836,"log_dups_size":0,"ondisk_log_size":4836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95617024,"num_objects":1459,"num_object_clones":0,"num_object_copies":4377,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4837,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'4639","reported_seq":4677,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.299416+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:07:46.299416+0000","last_peered":"2024-09-22T03:07:46.299416+0000","last_clean":"2024-09-22T03:07:46.299416+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:07:46.299416+0000","last_undegraded":"2024-09-22T03:07:46.299416+0000","last_fullsized":"2024-09-22T03:07:46.299416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4639,"log_dups_size":0,"ondisk_log_size":4639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92733464,"num_objects":1416,"num_object_clones":0,"num_object_copies":4248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4640,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'4787","reported_seq":4824,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:49.185106+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:07:49.185106+0000","last_peered":"2024-09-22T03:07:49.185106+0000","last_clean":"2024-09-22T03:07:49.185106+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:07:49.185106+0000","last_undegraded":"2024-09-22T03:07:49.185106+0000","last_fullsized":"2024-09-22T03:07:49.185106+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4787,"log_dups_size":0,"ondisk_log_size":4787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93585408,"num_objects":1428,"num_object_clones":0,"num_object_copies":4284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4788,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'4672","reported_seq":4709,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.355691+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:07:46.355691+0000","last_peered":"2024-09-22T03:07:46.355691+0000","last_clean":"2024-09-22T03:07:46.355691+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:07:46.355691+0000","last_undegraded":"2024-09-22T03:07:46.355691+0000","last_fullsized":"2024-09-22T03:07:46.355691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4672,"log_dups_size":0,"ondisk_log_size":4672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94699520,"num_objects":1445,"num_object_clones":0,"num_object_copies":4335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4673,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'4834","reported_seq":4871,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:49.218448+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:07:49.218448+0000","last_peered":"2024-09-22T03:07:49.218448+0000","last_clean":"2024-09-22T03:07:49.218448+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:07:49.218448+0000","last_undegraded":"2024-09-22T03:07:49.218448+0000","last_fullsized":"2024-09-22T03:07:49.218448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4834,"log_dups_size":0,"ondisk_log_size":4834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96534528,"num_objects":1473,"num_object_clones":0,"num_object_copies":4419,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4835,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'4907","reported_seq":4944,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:49.149050+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:07:49.149050+0000","last_peered":"2024-09-22T03:07:49.149050+0000","last_clean":"2024-09-22T03:07:49.149050+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:07:49.149050+0000","last_undegraded":"2024-09-22T03:07:49.149050+0000","last_fullsized":"2024-09-22T03:07:49.149050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4907,"log_dups_size":0,"ondisk_log_size":4907,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94633984,"num_objects":1444,"num_object_clones":0,"num_object_copies":4332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4908,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'4708","reported_seq":4745,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.323013+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:07:46.323013+0000","last_peered":"2024-09-22T03:07:46.323013+0000","last_clean":"2024-09-22T03:07:46.323013+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:07:46.323013+0000","last_undegraded":"2024-09-22T03:07:46.323013+0000","last_fullsized":"2024-09-22T03:07:46.323013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4708,"log_dups_size":0,"ondisk_log_size":4708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96927744,"num_objects":1479,"num_object_clones":0,"num_object_copies":4437,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4709,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'4804","reported_seq":4841,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.350489+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:07:46.350489+0000","last_peered":"2024-09-22T03:07:46.350489+0000","last_clean":"2024-09-22T03:07:46.350489+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:07:46.350489+0000","last_undegraded":"2024-09-22T03:07:46.350489+0000","last_fullsized":"2024-09-22T03:07:46.350489+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4804,"log_dups_size":0,"ondisk_log_size":4804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95092736,"num_objects":1451,"num_object_clones":0,"num_object_copies":4353,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4805,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'4623","reported_seq":4660,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.228101+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:07:46.228101+0000","last_peered":"2024-09-22T03:07:46.228101+0000","last_clean":"2024-09-22T03:07:46.228101+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:07:46.228101+0000","last_undegraded":"2024-09-22T03:07:46.228101+0000","last_fullsized":"2024-09-22T03:07:46.228101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4623,"log_dups_size":0,"ondisk_log_size":4623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":97124352,"num_objects":1482,"num_object_clones":0,"num_object_copies":4446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4624,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'4757","reported_seq":4794,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.355404+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:07:46.355404+0000","last_peered":"2024-09-22T03:07:46.355404+0000","last_clean":"2024-09-22T03:07:46.355404+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:07:46.355404+0000","last_undegraded":"2024-09-22T03:07:46.355404+0000","last_fullsized":"2024-09-22T03:07:46.355404+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4757,"log_dups_size":0,"ondisk_log_size":4757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92143616,"num_objects":1406,"num_object_clones":0,"num_object_copies":4218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4758,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'4815","reported_seq":4852,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:45.998797+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:07:45.998797+0000","last_peered":"2024-09-22T03:07:45.998797+0000","last_clean":"2024-09-22T03:07:45.998797+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:07:45.998797+0000","last_undegraded":"2024-09-22T03:07:45.998797+0000","last_fullsized":"2024-09-22T03:07:45.998797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4815,"log_dups_size":0,"ondisk_log_size":4815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91357184,"num_objects":1394,"num_object_clones":0,"num_object_copies":4182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4816,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'4630","reported_seq":4667,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.338619+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:07:46.338619+0000","last_peered":"2024-09-22T03:07:46.338619+0000","last_clean":"2024-09-22T03:07:46.338619+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:07:46.338619+0000","last_undegraded":"2024-09-22T03:07:46.338619+0000","last_fullsized":"2024-09-22T03:07:46.338619+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4630,"log_dups_size":0,"ondisk_log_size":4630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93650944,"num_objects":1429,"num_object_clones":0,"num_object_copies":4287,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4631,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'4796","reported_seq":4833,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.275317+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:07:46.275317+0000","last_peered":"2024-09-22T03:07:46.275317+0000","last_clean":"2024-09-22T03:07:46.275317+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:07:46.275317+0000","last_undegraded":"2024-09-22T03:07:46.275317+0000","last_fullsized":"2024-09-22T03:07:46.275317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4796,"log_dups_size":0,"ondisk_log_size":4796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94699520,"num_objects":1445,"num_object_clones":0,"num_object_copies":4335,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4797,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'4691","reported_seq":4728,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.154352+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:07:46.154352+0000","last_peered":"2024-09-22T03:07:46.154352+0000","last_clean":"2024-09-22T03:07:46.154352+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:07:46.154352+0000","last_undegraded":"2024-09-22T03:07:46.154352+0000","last_fullsized":"2024-09-22T03:07:46.154352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4691,"log_dups_size":0,"ondisk_log_size":4691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":1472,"num_object_clones":0,"num_object_copies":4416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4692,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'4766","reported_seq":4803,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:07:46.407012+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:07:46.407012+0000","last_peered":"2024-09-22T03:07:46.407012+0000","last_clean":"2024-09-22T03:07:46.407012+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:07:46.407012+0000","last_undegraded":"2024-09-22T03:07:46.407012+0000","last_fullsized":"2024-09-22T03:07:46.407012+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":4766,"log_dups_size":0,"ondisk_log_size":4766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95879168,"num_objects":1463,"num_object_clones":0,"num_object_copies":4389,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4767,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1511653400,"num_objects":23067,"num_object_clones":0,"num_object_copies":69201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":76073,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":283848704,"data_stored":4541382728,"data_compressed":215649146,"data_compressed_allocated":283836416,"data_compressed_original":4541382656,"omap_allocated":0,"internal_metadata":0},"log_size":76057,"ondisk_log_size":76057,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673240,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":175020,"kb_used_data":81560,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94196820,"statfs":{"total":96636764160,"available":96457543680,"internally_reserved":0,"allocated":83517440,"data_stored":1332873443,"data_compressed":63288743,"data_compressed_allocated":83300352,"data_compressed_original":1332805632,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673240,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":127956,"kb_used_data":65028,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94243884,"statfs":{"total":96636764160,"available":96505737216,"internally_reserved":0,"allocated":66588672,"data_stored":1061685995,"data_compressed":50413241,"data_compressed_allocated":66355200,"data_compressed_original":1061601280,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673240,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":151048,"kb_used_data":70068,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94220792,"statfs":{"total":96636764160,"available":96482091008,"internally_reserved":0,"allocated":71749632,"data_stored":1144195843,"data_compressed":54331248,"data_compressed_allocated":71512064,"data_compressed_original":1144111104,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705948,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":125864,"kb_used_data":62936,"kb_used_omap":0,"kb_used_meta":62912,"kb_avail":94245976,"statfs":{"total":96636764160,"available":96507879424,"internally_reserved":0,"allocated":64446464,"data_stored":1027410672,"data_compressed":48785664,"data_compressed_allocated":64212992,"data_compressed_original":1027325952,"omap_allocated":0,"internal_metadata":64421888},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":63901696,"data_stored":1022361624,"data_compressed":48547198,"data_compressed_allocated":63897600,"data_compressed_original":1022361600,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":71102464,"data_stored":1137573912,"data_compressed":54018094,"data_compressed_allocated":71098368,"data_compressed_original":1137573888,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65961984,"data_stored":1055391744,"data_compressed":50115647,"data_compressed_allocated":65961984,"data_compressed_original":1055391744,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":82882560,"data_stored":1326055448,"data_compressed":62968207,"data_compressed_allocated":82878464,"data_compressed_original":1326055424,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:07:53.402 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:53.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:53.547+0000 7f02abb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:53.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:53.554+0000 7f02abb97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:55.876 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:07:56.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:56.020+0000 7f0e1042c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:56.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:56.027+0000 7f0e1042c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:57.636 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:07:57.636 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:07:57.636 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:07:57.636 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:07:57.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:57.756+0000 7f46e42d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:57.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:57.767+0000 7f46e42d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:57.862 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:57.862 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:57.862 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:57.862 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:57.862 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:57.862 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:57.862 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:57.862 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:57.863 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:57.863 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:57.863 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:57.863 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:57.865 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:57.865 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:57.866 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:07:58.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:58.002+0000 7f83f6157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:58.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:58.015+0000 7f83f6157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:58.183 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:58.183 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:58.183 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:58.183 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:58.183 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:58.183 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:58.184 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:58.184 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:58.184 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:58.184 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:58.184 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:58.184 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:58.187 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:58.187 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:58.187 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:07:58.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:58.325+0000 7f0ba3c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:58.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:58.337+0000 7f0ba3c2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:58.350 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:07:58.403 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:58.403 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:58.404 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:58.404 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:58.404 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:58.404 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:58.404 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:58.404 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:58.404 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:58.404 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:58.404 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:58.404 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:58.414 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:58.414 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:07:58.414 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:07:58.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:58.484+0000 7f5788597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:58.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:58.490+0000 7f5788597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:58.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:58.556+0000 7f4320b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:58.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:07:58.569+0000 7f4320b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:07:58.652 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:07:58.652 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:07:58.652 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:07:58.652 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:07:58.653 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:07:58.653 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:07:58.653 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:07:58.653 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:07:58.653 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:07:58.653 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:07:58.653 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:07:58.653 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:07:58.655 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:07:58.656 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:00.895 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:01.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:01.214+0000 7ff09c597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:01.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:01.220+0000 7ff09c597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:03.574 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:03.656 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:03.657 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:03.657 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:03.657 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:03.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:03.709+0000 7f37ba197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:03.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:03.716+0000 7f37ba197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:03.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:03.796+0000 7f11c8458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:03.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:03.808+0000 7f11c8458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:03.831 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:03.831 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:03.831 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:03.831 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:03.831 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:03.831 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:03.832 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:03.832 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:03.832 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:03.832 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:03.832 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:03.832 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:03.835 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:03.835 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:03.835 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:03.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:03.971+0000 7fb7fa6fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:03.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:03.981+0000 7fb7fa6fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:04.034 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:04.034 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:04.034 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:04.035 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:04.035 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:04.035 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:04.035 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:04.035 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:04.035 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:04.036 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:04.036 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:04.036 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:04.039 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:04.039 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:04.039 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:04.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:04.172+0000 7f8313e58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:04.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:04.183+0000 7f8313e58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:04.209 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:04.209 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:04.209 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:04.210 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:04.210 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:04.210 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:04.210 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:04.210 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:04.210 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:04.210 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:04.210 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:04.210 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:04.215 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:04.215 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:04.215 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:04.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:04.361+0000 7fd164b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:04.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:04.375+0000 7fd164b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:04.414 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:04.414 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:04.414 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:04.414 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:04.414 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:04.414 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:04.414 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:04.415 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:04.415 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:04.415 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:04.415 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:04.415 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:04.418 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:04.418 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:06.118 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:06.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:06.257+0000 7fe4a1397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:06.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:06.263+0000 7fe4a1397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:08.496 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:08.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:08.635+0000 7f84cd197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:08.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:08.640+0000 7f84cd197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:09.419 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:09.419 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:09.419 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:09.419 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:09.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:09.542+0000 7f7fca26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:09.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:09.557+0000 7f7fca26c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:09.647 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:09.647 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:09.647 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:09.647 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:09.647 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:09.647 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:09.647 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:09.647 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:09.647 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:09.647 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:09.648 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:09.648 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:09.651 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:09.651 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:09.651 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:09.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:09.782+0000 7f8c3d02c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:09.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:09.790+0000 7f8c3d02c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:09.890 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:09.890 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:09.891 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:09.891 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:09.891 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:09.891 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:09.891 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:09.891 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:09.891 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:09.891 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:09.891 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:09.891 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:09.894 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:09.895 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:09.895 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:10.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:10.039+0000 7f4186797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:10.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:10.052+0000 7f4186797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:10.090 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:10.090 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:10.090 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:10.090 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:10.090 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:10.090 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:10.090 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:10.090 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:10.090 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:10.091 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:10.091 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:10.091 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:10.093 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:10.093 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:10.093 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:10.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:10.210+0000 7fc84446c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:10.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:10.224+0000 7fc84446c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:10.242 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:10.242 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:10.242 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:10.242 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:10.243 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:10.243 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:10.243 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:10.243 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:10.243 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:10.243 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:10.243 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:10.243 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:10.246 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:10.246 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:11.103 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:11.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:11.233+0000 7f89fb4a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:11.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:11.240+0000 7f89fb4a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:13.513 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:13.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:13.630+0000 7f50dde2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:13.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:13.635+0000 7f50dde2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:15.247 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:15.247 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:15.247 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:15.248 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:15.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:15.384+0000 7fdc07597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:15.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:15.397+0000 7fdc07597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:15.460 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:15.460 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:15.460 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:15.460 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:15.460 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:15.460 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:15.461 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:15.461 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:15.461 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:15.461 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:15.461 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:15.461 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:15.464 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:15.465 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:15.465 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:15.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:15.596+0000 7f572446c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:15.606+0000 7f572446c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:15.703 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:15.704 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:15.704 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:15.706 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:15.706 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:15.706 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:15.824+0000 7fa797b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:15.835+0000 7fa797b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:15.853 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:15.853 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:15.853 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:15.853 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:15.853 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:15.853 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:15.854 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:15.854 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:15.854 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:15.854 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:15.854 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:15.854 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:15.857 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:15.858 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:15.858 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:16.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:15.996+0000 7f2c554a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:16.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:16.007+0000 7f2c554a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:16.026 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:16.026 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:16.026 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:16.026 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:16.026 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:16.026 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:16.026 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:16.026 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:16.026 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:16.026 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:16.026 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:16.026 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:16.029 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:16.030 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:16.056 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:16.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:16.183+0000 7f7408f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:16.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:16.191+0000 7f7408f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:18.440 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:18.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:18.577+0000 7f1c3c46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:18.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:18.584+0000 7f1c3c46c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:20.722 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:20.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:20.843+0000 7f19a0997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:20.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:20.849+0000 7f19a0997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:21.031 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:21.031 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:21.031 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:21.031 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:21.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:21.169+0000 7f22e6c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:21.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:21.184+0000 7f22e6c6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:21.216 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:21.217 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:21.217 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:21.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:21.338+0000 7f43e0597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:21.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:21.347+0000 7f43e0597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:21.431 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:21.431 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:21.431 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:21.431 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:21.431 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:21.432 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:21.432 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:21.432 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:21.432 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:21.432 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:21.432 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:21.432 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:21.435 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:21.436 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:21.436 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:21.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:21.570+0000 7fa799c58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:21.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:21.581+0000 7fa799c58640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:21.618 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:21.618 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:21.618 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:21.618 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:21.618 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:21.618 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:21.618 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:21.618 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:21.619 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:21.619 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:21.619 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:21.619 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:21.621 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:21.621 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:21.622 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:21.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:21.759+0000 7f9d33d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:21.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:21.769+0000 7f9d33d97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:21.811 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:21.811 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:21.811 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:21.811 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:21.812 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:21.812 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:21.812 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:21.812 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:21.812 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:21.812 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:21.812 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:21.813 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:21.815 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:21.815 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:23.042 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:23.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:23.174+0000 7f0cd2397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:23.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:23.180+0000 7f0cd2397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:25.516 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:25.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:25.654+0000 7f3287397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:25.661+0000 7f3287397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:26.816 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:26.816 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:26.816 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:26.816 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:26.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:26.952+0000 7f156da23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:26.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:26.962+0000 7f156da23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:27.060 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:27.061 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:27.063 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:27.064 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:27.064 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:27.191+0000 7f4451b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:27.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:27.200+0000 7f4451b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:27.250 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:27.250 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:27.252 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:27.253 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:27.253 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:27.400+0000 7fa3e1357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:27.410+0000 7fa3e1357640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:27.432 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:27.436 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:27.436 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:27.437 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:27.571+0000 7f7635f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:27.581+0000 7f7635f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:27.595 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:27.595 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:27.595 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:27.595 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:27.596 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:27.596 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:27.596 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:27.596 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:27.596 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:27.596 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:27.596 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:27.596 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:27.600 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:27.600 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:28.203 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:28.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:28.346+0000 7f7a1a997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:28.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:28.353+0000 7f7a1a997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:30.606 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:30.756+0000 7f3789397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:30.761+0000 7f3789397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:32.600 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:32.601 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:32.601 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:32.601 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:32.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:32.740+0000 7f63b5797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:32.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:32.751+0000 7f63b5797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:32.768 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:32.768 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:32.768 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:32.768 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:32.768 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:32.768 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:32.768 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:32.768 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:32.769 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:32.769 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:32.769 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:32.769 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:32.773 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:32.774 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:32.774 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:32.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:32.917+0000 7f4288863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:32.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:32.927+0000 7f4288863640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:33.042 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:33.042 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:33.042 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:33.042 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:33.043 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:33.043 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:33.043 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:33.043 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:33.043 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:33.043 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:33.043 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:33.043 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:33.045 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:33.045 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:33.046 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:33.055 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:33.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:33.184+0000 7f5718c23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:33.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:33.199+0000 7f5718c23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:33.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:33.229+0000 7ff4ef2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:33.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:33.234+0000 7ff4ef2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:33.254 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:33.255 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:33.257 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:33.258 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:33.258 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:33.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:33.397+0000 7fc59d597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:33.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:33.412+0000 7fc597fff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:33.435 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:33.436 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:33.439 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:33.439 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:35.661 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:35.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:35.790+0000 7f0610957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:35.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:35.796+0000 7f060b59e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:38.274 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:38.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:38.403+0000 7fa2a846c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:38.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:38.411+0000 7fa2a846c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:38.440 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:38.440 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:38.440 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:08:38.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:38.582+0000 7f8915b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:38.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:38.592+0000 7f8915b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:38.888 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:08:38.889 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:08:38.910 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-22T03:08:37.365694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":903676491,"num_objects":13785,"num_object_clones":0,"num_object_copies":41355,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":85498,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85443,"ondisk_log_size":85443,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":537128,"kb_used_data":167456,"kb_used_omap":0,"kb_used_meta":369600,"kb_avail":376950232,"statfs":{"total":386547056640,"available":385997037568,"internally_reserved":0,"allocated":171474944,"data_stored":2728929729,"data_compressed":129577091,"data_compressed_allocated":170553344,"data_compressed_original":2728607744,"omap_allocated":0,"internal_metadata":378470400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-165937152,"num_objects":-2532,"num_object_clones":0,"num_object_copies":-7596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2532,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002355"},"pg_stats":[{"pgid":"3.f","version":"25'5318","reported_seq":5355,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:34.368281+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:08:34.368281+0000","last_peered":"2024-09-22T03:08:34.368281+0000","last_clean":"2024-09-22T03:08:34.368281+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:08:34.368281+0000","last_undegraded":"2024-09-22T03:08:34.368281+0000","last_fullsized":"2024-09-22T03:08:34.368281+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5318,"log_dups_size":0,"ondisk_log_size":5318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033280,"num_objects":855,"num_object_clones":0,"num_object_copies":2565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5319,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'5440","reported_seq":5477,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:36.411071+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:08:36.411071+0000","last_peered":"2024-09-22T03:08:36.411071+0000","last_clean":"2024-09-22T03:08:36.411071+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:08:36.411071+0000","last_undegraded":"2024-09-22T03:08:36.411071+0000","last_fullsized":"2024-09-22T03:08:36.411071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5440,"log_dups_size":0,"ondisk_log_size":5440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56033280,"num_objects":855,"num_object_clones":0,"num_object_copies":2565,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5441,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'5217","reported_seq":5255,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:36.360500+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:08:36.360500+0000","last_peered":"2024-09-22T03:08:36.360500+0000","last_clean":"2024-09-22T03:08:36.360500+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:08:36.360500+0000","last_undegraded":"2024-09-22T03:08:36.360500+0000","last_fullsized":"2024-09-22T03:08:36.360500+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5217,"log_dups_size":0,"ondisk_log_size":5217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54853656,"num_objects":838,"num_object_clones":0,"num_object_copies":2514,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5218,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'5338","reported_seq":5375,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:34.305154+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:08:34.305154+0000","last_peered":"2024-09-22T03:08:34.305154+0000","last_clean":"2024-09-22T03:08:34.305154+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:08:34.305154+0000","last_undegraded":"2024-09-22T03:08:34.305154+0000","last_fullsized":"2024-09-22T03:08:34.305154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5338,"log_dups_size":0,"ondisk_log_size":5338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57475072,"num_objects":877,"num_object_clones":0,"num_object_copies":2631,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5339,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'5256","reported_seq":5293,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:36.231149+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:08:36.231149+0000","last_peered":"2024-09-22T03:08:36.231149+0000","last_clean":"2024-09-22T03:08:36.231149+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:08:36.231149+0000","last_undegraded":"2024-09-22T03:08:36.231149+0000","last_fullsized":"2024-09-22T03:08:36.231149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5256,"log_dups_size":0,"ondisk_log_size":5256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56426496,"num_objects":861,"num_object_clones":0,"num_object_copies":2583,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5257,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'5356","reported_seq":5393,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:34.369288+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:08:34.369288+0000","last_peered":"2024-09-22T03:08:34.369288+0000","last_clean":"2024-09-22T03:08:34.369288+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:08:34.369288+0000","last_undegraded":"2024-09-22T03:08:34.369288+0000","last_fullsized":"2024-09-22T03:08:34.369288+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5356,"log_dups_size":0,"ondisk_log_size":5356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62324736,"num_objects":951,"num_object_clones":0,"num_object_copies":2853,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5357,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'5462","reported_seq":5499,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:34.174231+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:08:34.174231+0000","last_peered":"2024-09-22T03:08:34.174231+0000","last_clean":"2024-09-22T03:08:34.174231+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:08:34.174231+0000","last_undegraded":"2024-09-22T03:08:34.174231+0000","last_fullsized":"2024-09-22T03:08:34.174231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5462,"log_dups_size":0,"ondisk_log_size":5462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58261504,"num_objects":889,"num_object_clones":0,"num_object_copies":2667,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5463,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'5336","reported_seq":5373,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:36.401674+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:08:36.401674+0000","last_peered":"2024-09-22T03:08:36.401674+0000","last_clean":"2024-09-22T03:08:36.401674+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:08:36.401674+0000","last_undegraded":"2024-09-22T03:08:36.401674+0000","last_fullsized":"2024-09-22T03:08:36.401674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5336,"log_dups_size":0,"ondisk_log_size":5336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55771136,"num_objects":851,"num_object_clones":0,"num_object_copies":2553,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5337,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'5425","reported_seq":5462,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:36.324511+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:08:36.324511+0000","last_peered":"2024-09-22T03:08:36.324511+0000","last_clean":"2024-09-22T03:08:36.324511+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:08:36.324511+0000","last_undegraded":"2024-09-22T03:08:36.324511+0000","last_fullsized":"2024-09-22T03:08:36.324511+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5425,"log_dups_size":0,"ondisk_log_size":5425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54394880,"num_objects":830,"num_object_clones":0,"num_object_copies":2490,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5426,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'5196","reported_seq":5233,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:36.112633+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:08:36.112633+0000","last_peered":"2024-09-22T03:08:36.112633+0000","last_clean":"2024-09-22T03:08:36.112633+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:08:36.112633+0000","last_undegraded":"2024-09-22T03:08:36.112633+0000","last_fullsized":"2024-09-22T03:08:36.112633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5196,"log_dups_size":0,"ondisk_log_size":5196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59572224,"num_objects":909,"num_object_clones":0,"num_object_copies":2727,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5197,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'5326","reported_seq":5363,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:36.047918+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:08:36.047918+0000","last_peered":"2024-09-22T03:08:36.047918+0000","last_clean":"2024-09-22T03:08:36.047918+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:08:36.047918+0000","last_undegraded":"2024-09-22T03:08:36.047918+0000","last_fullsized":"2024-09-22T03:08:36.047918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5326,"log_dups_size":0,"ondisk_log_size":5326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54853632,"num_objects":837,"num_object_clones":0,"num_object_copies":2511,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5327,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'5409","reported_seq":5446,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:36.309635+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:08:36.309635+0000","last_peered":"2024-09-22T03:08:36.309635+0000","last_clean":"2024-09-22T03:08:36.309635+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:08:36.309635+0000","last_undegraded":"2024-09-22T03:08:36.309635+0000","last_fullsized":"2024-09-22T03:08:36.309635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5409,"log_dups_size":0,"ondisk_log_size":5409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52428800,"num_objects":800,"num_object_clones":0,"num_object_copies":2400,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5410,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'5190","reported_seq":5227,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:36.041968+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:08:36.041968+0000","last_peered":"2024-09-22T03:08:36.041968+0000","last_clean":"2024-09-22T03:08:36.041968+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:08:36.041968+0000","last_undegraded":"2024-09-22T03:08:36.041968+0000","last_fullsized":"2024-09-22T03:08:36.041968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5190,"log_dups_size":0,"ondisk_log_size":5190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56950784,"num_objects":869,"num_object_clones":0,"num_object_copies":2607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5191,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'5395","reported_seq":5432,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:35.979498+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:08:35.979498+0000","last_peered":"2024-09-22T03:08:35.979498+0000","last_clean":"2024-09-22T03:08:35.979498+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:08:35.979498+0000","last_undegraded":"2024-09-22T03:08:35.979498+0000","last_fullsized":"2024-09-22T03:08:35.979498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5395,"log_dups_size":0,"ondisk_log_size":5395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55443456,"num_objects":846,"num_object_clones":0,"num_object_copies":2538,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5396,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'5302","reported_seq":5339,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:36.202201+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:08:36.202201+0000","last_peered":"2024-09-22T03:08:36.202201+0000","last_clean":"2024-09-22T03:08:36.202201+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:08:36.202201+0000","last_undegraded":"2024-09-22T03:08:36.202201+0000","last_fullsized":"2024-09-22T03:08:36.202201+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5302,"log_dups_size":0,"ondisk_log_size":5302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56426496,"num_objects":861,"num_object_clones":0,"num_object_copies":2583,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5303,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'5377","reported_seq":5414,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:36.391030+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:08:36.391030+0000","last_peered":"2024-09-22T03:08:36.391030+0000","last_clean":"2024-09-22T03:08:36.391030+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:08:36.391030+0000","last_undegraded":"2024-09-22T03:08:36.391030+0000","last_fullsized":"2024-09-22T03:08:36.391030+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5377,"log_dups_size":0,"ondisk_log_size":5377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55836672,"num_objects":852,"num_object_clones":0,"num_object_copies":2556,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5378,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":903086104,"num_objects":13781,"num_object_clones":0,"num_object_copies":41343,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":85359,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":169250816,"data_stored":2707816520,"data_compressed":128581613,"data_compressed_allocated":169238528,"data_compressed_original":2707816448,"omap_allocated":0,"internal_metadata":0},"log_size":85343,"ondisk_log_size":85343,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673290,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":141580,"kb_used_data":48120,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94230260,"statfs":{"total":96636764160,"available":96491786240,"internally_reserved":0,"allocated":49274880,"data_stored":784992483,"data_compressed":37272423,"data_compressed_allocated":49057792,"data_compressed_original":784924672,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673290,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":132104,"kb_used_data":38648,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94239736,"statfs":{"total":96636764160,"available":96501489664,"internally_reserved":0,"allocated":39575552,"data_stored":629476075,"data_compressed":29889602,"data_compressed_allocated":39342080,"data_compressed_original":629391360,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673290,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":134852,"kb_used_data":41396,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94236988,"statfs":{"total":96636764160,"available":96498675712,"internally_reserved":0,"allocated":42389504,"data_stored":674433795,"data_compressed":32024433,"data_compressed_allocated":42151936,"data_compressed_original":674349056,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128592,"kb_used_data":39292,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94243248,"statfs":{"total":96636764160,"available":96505085952,"internally_reserved":0,"allocated":40235008,"data_stored":640027376,"data_compressed":30390633,"data_compressed_allocated":40001536,"data_compressed_original":639942656,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":39649280,"data_stored":634322968,"data_compressed":30121047,"data_compressed_allocated":39645184,"data_compressed_original":634322944,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41795584,"data_stored":668663832,"data_compressed":31751735,"data_compressed_allocated":41791488,"data_compressed_original":668663808,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":39063552,"data_stored":625016832,"data_compressed":29679144,"data_compressed_allocated":39063552,"data_compressed_original":625016832,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":48742400,"data_stored":779812888,"data_compressed":37029687,"data_compressed_allocated":48738304,"data_compressed_original":779812864,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:08:40.605 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:40.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:40.726+0000 7f4415197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:40.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:40.731+0000 7f4415197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:42.994 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:43.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:43.139+0000 7fafb34ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:43.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:43.145+0000 7fafb34ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:43.912 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:43.912 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:43.912 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:43.913 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:44.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:44.030+0000 7f2194e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:44.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:44.039+0000 7f2194e6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:44.073 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:44.073 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:44.073 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:44.073 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:44.074 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:44.074 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:44.074 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:44.074 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:44.074 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:44.074 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:44.074 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:44.074 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:44.077 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:44.078 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:44.078 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:44.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:44.201+0000 7feef4797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:44.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:44.210+0000 7feef4797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:44.353 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:44.354 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:44.354 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:44.354 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:44.354 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:44.354 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:44.354 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:44.354 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:44.354 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:44.354 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:44.354 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:44.354 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:44.357 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:44.357 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:44.357 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:44.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:44.493+0000 7f04acd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:44.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:44.504+0000 7f04acd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:44.595 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:44.596 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:44.596 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:44.596 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:44.596 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:44.596 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:44.596 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:44.596 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:44.596 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:44.596 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:44.596 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:44.596 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:44.598 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:44.599 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:44.599 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:44.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:44.737+0000 7f1aee397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:44.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:44.748+0000 7f1aee397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:44.765 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:44.765 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:44.765 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:44.765 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:44.765 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:44.765 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:44.765 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:44.765 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:44.766 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:44.766 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:44.766 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:44.766 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:44.770 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:44.770 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:45.582 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:45.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:45.719+0000 7fa3e1797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:45.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:45.725+0000 7fa3e1797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:48.073 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:48.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:48.212+0000 7fa856757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:48.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:48.219+0000 7fa856757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:49.770 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:49.773 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:49.773 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:08:49.774 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:08:49.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:49.911+0000 7f598f06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:49.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:49.924+0000 7f598f06c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:50.052 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:50.052 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:50.053 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:50.056 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:50.057 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:50.057 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:08:50.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:50.195+0000 7f2236b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:50.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:50.204+0000 7f2236b57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:50.281 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:50.281 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:50.281 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:50.281 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:50.281 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:50.281 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:50.282 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:50.282 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:50.282 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:50.282 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:50.282 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:50.282 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:50.284 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:50.285 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:50.285 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:08:50.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:50.422+0000 7f4150a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:50.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:50.431+0000 7f4150a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:50.458 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:50.459 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:50.459 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:50.459 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:50.459 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:50.459 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:50.459 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:50.459 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:50.459 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:50.459 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:50.459 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:50.459 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:50.461 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:50.462 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:50.462 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:08:50.613 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:50.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:50.606+0000 7f4222f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:50.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:50.621+0000 7f4222f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:50.660 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:08:50.660 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:08:50.660 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:08:50.660 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:08:50.660 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:08:50.660 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:08:50.660 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:08:50.660 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:08:50.660 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:08:50.660 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:08:50.660 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:08:50.661 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:08:50.665 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:08:50.665 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:08:50.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:50.757+0000 7f5fadb17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:50.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:50.764+0000 7f5fadb17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:53.021 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:53.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:53.158+0000 7f1e4914e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:53.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:53.163+0000 7f1e4914e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:55.543 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:08:55.666 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:08:55.666 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:08:55.666 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:08:55.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:55.696+0000 7f91a806c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:55.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:55.704+0000 7f91a806c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:55.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:55.804+0000 7f980882c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:55.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:55.812+0000 7f980882c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:56.142 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:08:56.143 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:08:56.158 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2024-09-22T03:08:55.368659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":708510283,"num_objects":10807,"num_object_clones":0,"num_object_copies":32421,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":88476,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88421,"ondisk_log_size":88421,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":468312,"kb_used_data":131920,"kb_used_omap":0,"kb_used_meta":336320,"kb_avail":377019048,"statfs":{"total":386547056640,"available":386067505152,"internally_reserved":0,"allocated":135086080,"data_stored":2146707905,"data_compressed":101930083,"data_compressed_allocated":134164480,"data_compressed_original":2146385920,"omap_allocated":0,"internal_metadata":344391680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-134479872,"num_objects":-2052,"num_object_clones":0,"num_object_copies":-6156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2052,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001980"},"pg_stats":[{"pgid":"3.f","version":"25'5530","reported_seq":5567,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:54.356469+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:08:54.356469+0000","last_peered":"2024-09-22T03:08:54.356469+0000","last_clean":"2024-09-22T03:08:54.356469+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:08:54.356469+0000","last_undegraded":"2024-09-22T03:08:54.356469+0000","last_fullsized":"2024-09-22T03:08:54.356469+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42139648,"num_objects":643,"num_object_clones":0,"num_object_copies":1929,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5531,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'5634","reported_seq":5671,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.203897+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:08:51.203897+0000","last_peered":"2024-09-22T03:08:51.203897+0000","last_clean":"2024-09-22T03:08:51.203897+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:08:51.203897+0000","last_undegraded":"2024-09-22T03:08:51.203897+0000","last_fullsized":"2024-09-22T03:08:51.203897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5634,"log_dups_size":0,"ondisk_log_size":5634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43319296,"num_objects":661,"num_object_clones":0,"num_object_copies":1983,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5635,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'5383","reported_seq":5421,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.299322+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:08:51.299322+0000","last_peered":"2024-09-22T03:08:51.299322+0000","last_clean":"2024-09-22T03:08:51.299322+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:08:51.299322+0000","last_undegraded":"2024-09-22T03:08:51.299322+0000","last_fullsized":"2024-09-22T03:08:51.299322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5383,"log_dups_size":0,"ondisk_log_size":5383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43974680,"num_objects":672,"num_object_clones":0,"num_object_copies":2016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5384,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"25'5571","reported_seq":5608,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:54.276538+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:08:54.276538+0000","last_peered":"2024-09-22T03:08:54.276538+0000","last_clean":"2024-09-22T03:08:54.276538+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:08:54.276538+0000","last_undegraded":"2024-09-22T03:08:54.276538+0000","last_fullsized":"2024-09-22T03:08:54.276538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5571,"log_dups_size":0,"ondisk_log_size":5571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42205184,"num_objects":644,"num_object_clones":0,"num_object_copies":1932,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5572,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'5425","reported_seq":5462,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.336664+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:08:51.336664+0000","last_peered":"2024-09-22T03:08:51.336664+0000","last_clean":"2024-09-22T03:08:51.336664+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:08:51.336664+0000","last_undegraded":"2024-09-22T03:08:51.336664+0000","last_fullsized":"2024-09-22T03:08:51.336664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5425,"log_dups_size":0,"ondisk_log_size":5425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45350912,"num_objects":692,"num_object_clones":0,"num_object_copies":2076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5426,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"25'5608","reported_seq":5645,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:54.339880+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:08:54.339880+0000","last_peered":"2024-09-22T03:08:54.339880+0000","last_clean":"2024-09-22T03:08:54.339880+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:08:54.339880+0000","last_undegraded":"2024-09-22T03:08:54.339880+0000","last_fullsized":"2024-09-22T03:08:54.339880+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5608,"log_dups_size":0,"ondisk_log_size":5608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45809664,"num_objects":699,"num_object_clones":0,"num_object_copies":2097,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5609,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"25'5680","reported_seq":5717,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:54.289301+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:08:54.289301+0000","last_peered":"2024-09-22T03:08:54.289301+0000","last_clean":"2024-09-22T03:08:54.289301+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:08:54.289301+0000","last_undegraded":"2024-09-22T03:08:54.289301+0000","last_fullsized":"2024-09-22T03:08:54.289301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5680,"log_dups_size":0,"ondisk_log_size":5680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43974656,"num_objects":671,"num_object_clones":0,"num_object_copies":2013,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5681,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'5530","reported_seq":5567,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.230119+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:08:51.230119+0000","last_peered":"2024-09-22T03:08:51.230119+0000","last_clean":"2024-09-22T03:08:51.230119+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:08:51.230119+0000","last_undegraded":"2024-09-22T03:08:51.230119+0000","last_fullsized":"2024-09-22T03:08:51.230119+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5530,"log_dups_size":0,"ondisk_log_size":5530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43057152,"num_objects":657,"num_object_clones":0,"num_object_copies":1971,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5531,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'5575","reported_seq":5612,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.384136+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:08:51.384136+0000","last_peered":"2024-09-22T03:08:51.384136+0000","last_clean":"2024-09-22T03:08:51.384136+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:08:51.384136+0000","last_undegraded":"2024-09-22T03:08:51.384136+0000","last_fullsized":"2024-09-22T03:08:51.384136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5575,"log_dups_size":0,"ondisk_log_size":5575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44564480,"num_objects":680,"num_object_clones":0,"num_object_copies":2040,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5576,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.425603+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:04:38.425603+0000","last_peered":"2024-09-22T03:04:38.425603+0000","last_clean":"2024-09-22T03:04:38.425603+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:04:38.425603+0000","last_undegraded":"2024-09-22T03:04:38.425603+0000","last_fullsized":"2024-09-22T03:04:38.425603+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'5335","reported_seq":5372,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.186372+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:08:51.186372+0000","last_peered":"2024-09-22T03:08:51.186372+0000","last_clean":"2024-09-22T03:08:51.186372+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:08:51.186372+0000","last_undegraded":"2024-09-22T03:08:51.186372+0000","last_fullsized":"2024-09-22T03:08:51.186372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5335,"log_dups_size":0,"ondisk_log_size":5335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50462720,"num_objects":770,"num_object_clones":0,"num_object_copies":2310,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5336,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'5505","reported_seq":5542,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.267383+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:08:51.267383+0000","last_peered":"2024-09-22T03:08:51.267383+0000","last_clean":"2024-09-22T03:08:51.267383+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:08:51.267383+0000","last_undegraded":"2024-09-22T03:08:51.267383+0000","last_fullsized":"2024-09-22T03:08:51.267383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5505,"log_dups_size":0,"ondisk_log_size":5505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43122688,"num_objects":658,"num_object_clones":0,"num_object_copies":1974,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5506,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":175,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.431060+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:04:38.431060+0000","last_peered":"2024-09-22T03:04:38.431060+0000","last_clean":"2024-09-22T03:04:38.431060+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:04:38.431060+0000","last_undegraded":"2024-09-22T03:04:38.431060+0000","last_fullsized":"2024-09-22T03:04:38.431060+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'5570","reported_seq":5607,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.296039+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:08:51.296039+0000","last_peered":"2024-09-22T03:08:51.296039+0000","last_clean":"2024-09-22T03:08:51.296039+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:08:51.296039+0000","last_undegraded":"2024-09-22T03:08:51.296039+0000","last_fullsized":"2024-09-22T03:08:51.296039+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5570,"log_dups_size":0,"ondisk_log_size":5570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41877504,"num_objects":639,"num_object_clones":0,"num_object_copies":1917,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5571,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'5375","reported_seq":5412,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.339961+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:08:51.339961+0000","last_peered":"2024-09-22T03:08:51.339961+0000","last_clean":"2024-09-22T03:08:51.339961+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:08:51.339961+0000","last_undegraded":"2024-09-22T03:08:51.339961+0000","last_fullsized":"2024-09-22T03:08:51.339961+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5375,"log_dups_size":0,"ondisk_log_size":5375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44826624,"num_objects":684,"num_object_clones":0,"num_object_copies":2052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5376,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'5569","reported_seq":5606,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.317555+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:08:51.317555+0000","last_peered":"2024-09-22T03:08:51.317555+0000","last_clean":"2024-09-22T03:08:51.317555+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:08:51.317555+0000","last_undegraded":"2024-09-22T03:08:51.317555+0000","last_fullsized":"2024-09-22T03:08:51.317555+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5569,"log_dups_size":0,"ondisk_log_size":5569,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":672,"num_object_clones":0,"num_object_copies":2016,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5570,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'5461","reported_seq":5498,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.215375+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:08:51.215375+0000","last_peered":"2024-09-22T03:08:51.215375+0000","last_clean":"2024-09-22T03:08:51.215375+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:08:51.215375+0000","last_undegraded":"2024-09-22T03:08:51.215375+0000","last_fullsized":"2024-09-22T03:08:51.215375+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5461,"log_dups_size":0,"ondisk_log_size":5461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46006272,"num_objects":702,"num_object_clones":0,"num_object_copies":2106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5462,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'5570","reported_seq":5607,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:08:51.199032+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:08:51.199032+0000","last_peered":"2024-09-22T03:08:51.199032+0000","last_clean":"2024-09-22T03:08:51.199032+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:08:51.199032+0000","last_undegraded":"2024-09-22T03:08:51.199032+0000","last_fullsized":"2024-09-22T03:08:51.199032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5570,"log_dups_size":0,"ondisk_log_size":5570,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43188224,"num_objects":659,"num_object_clones":0,"num_object_copies":1977,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5571,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":707919896,"num_objects":10803,"num_object_clones":0,"num_object_copies":32409,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":88337,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":132980736,"data_stored":2127495240,"data_compressed":101024853,"data_compressed_allocated":132968448,"data_compressed_original":2127495168,"omap_allocated":0,"internal_metadata":0},"log_size":88321,"ondisk_log_size":88321,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673305,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":127820,"kb_used_data":38520,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94244020,"statfs":{"total":96636764160,"available":96505876480,"internally_reserved":0,"allocated":39444480,"data_stored":627706083,"data_compressed":29803623,"data_compressed_allocated":39227392,"data_compressed_original":627638272,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673305,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111852,"kb_used_data":30872,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94259988,"statfs":{"total":96636764160,"available":96522227712,"internally_reserved":0,"allocated":31612928,"data_stored":502074091,"data_compressed":23839874,"data_compressed_allocated":31379456,"data_compressed_original":501989376,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673305,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":118152,"kb_used_data":33016,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94253688,"statfs":{"total":96636764160,"available":96515776512,"internally_reserved":0,"allocated":33808384,"data_stored":537135875,"data_compressed":25504793,"data_compressed_allocated":33570816,"data_compressed_original":537051136,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706013,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110488,"kb_used_data":29512,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94261352,"statfs":{"total":96636764160,"available":96523624448,"internally_reserved":0,"allocated":30220288,"data_stored":479791856,"data_compressed":22781793,"data_compressed_allocated":29986816,"data_compressed_original":479707136,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29704192,"data_stored":475201560,"data_compressed":22565111,"data_compressed_allocated":29700096,"data_compressed_original":475201536,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33230848,"data_stored":531628056,"data_compressed":25244543,"data_compressed_allocated":33226752,"data_compressed_original":531628032,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":31117312,"data_stored":497876992,"data_compressed":23641864,"data_compressed_allocated":31117312,"data_compressed_original":497876992,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":38928384,"data_stored":622788632,"data_compressed":29573335,"data_compressed_allocated":38924288,"data_compressed_original":622788608,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:08:58.514 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:08:58.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:58.635+0000 7fb2fe757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:08:58.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:08:58.642+0000 7fb2fe757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:01.083 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:01.161 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:01.161 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:01.162 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:09:01.162 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:09:01.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:01.223+0000 7feb20b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:01.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:01.232+0000 7feb1b59e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:01.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:01.321+0000 7f913da6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:01.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:01.335+0000 7f913da6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:01.364 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:01.364 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:01.365 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:01.365 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:01.365 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:01.365 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:01.365 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:01.365 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:01.365 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:01.365 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:01.366 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:01.366 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:01.369 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:01.369 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:01.369 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:09:01.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:01.509+0000 7ff9e806c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:01.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:01.523+0000 7ff9e806c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:01.545 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:01.545 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:01.545 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:01.545 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:01.545 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:01.545 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:01.545 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:01.546 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:01.546 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:01.546 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:01.546 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:01.546 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:01.549 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:01.550 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:01.551 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:09:01.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:01.697+0000 7f8040f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:01.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:01.708+0000 7f8040f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:01.732 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:01.733 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:01.733 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:01.733 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:01.733 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:01.733 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:01.733 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:01.733 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:01.733 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:01.733 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:01.733 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:01.733 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:01.737 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:01.737 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:01.737 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:09:01.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:01.909+0000 7fc9ccac3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:01.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:01.919+0000 7fc9ccac3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:01.941 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:01.941 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:01.941 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:01.941 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:01.941 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:01.941 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:01.942 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:01.942 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:01.942 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:01.942 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:01.942 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:01.942 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:01.944 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:01.945 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:03.666 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:03.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:03.810+0000 7f316a117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:03.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:03.815+0000 7f316a117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:06.179 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:06.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:06.311+0000 7fc2b9397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:06.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:06.317+0000 7fc2b9397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:06.946 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:06.946 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:09:07.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:07.089+0000 7f79e4397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:07.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:07.102+0000 7f79e4397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:08.121 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:09:08.140 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:09:08.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:08.285+0000 7fd5a1b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:08.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:08.301+0000 7fd5a1b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:08.656 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:08.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:08.790+0000 7f970282c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:08.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:08.794+0000 7f970282c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:09.125 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:09:09.142 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:09:09.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:09.331+0000 7fe782157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:09.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:09.344+0000 7fe782157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:10.127 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:09:10.144 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:09:10.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:10.272+0000 7f2096cd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:10.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:10.283+0000 7f2096cd7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:11.126 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:11.130 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:09:11.151 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:09:11.152 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:09:11.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:11.269+0000 7f658e86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:11.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:11.275+0000 7f658e86c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:11.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:11.337+0000 7fa88290e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:11.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:11.345+0000 7fa88290e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:11.669 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:09:11.670 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:09:11.689 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-22T03:09:11.371325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":530842187,"num_objects":8096,"num_object_clones":0,"num_object_copies":24288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":91187,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91132,"ondisk_log_size":91132,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":452344,"kb_used_data":99312,"kb_used_omap":0,"kb_used_meta":352960,"kb_avail":377035016,"statfs":{"total":386547056640,"available":386083856384,"internally_reserved":0,"allocated":101695488,"data_stored":1612330634,"data_compressed":76554835,"data_compressed_allocated":100765696,"data_compressed_original":1612005376,"omap_allocated":0,"internal_metadata":361431040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14745600,"num_objects":-225,"num_object_clones":0,"num_object_copies":-675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000700"},"pg_stats":[{"pgid":"3.f","version":"26'5697","reported_seq":5740,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.175066+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:09:09.175066+0000","last_peered":"2024-09-22T03:09:09.175066+0000","last_clean":"2024-09-22T03:09:09.175066+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:09:09.175066+0000","last_undegraded":"2024-09-22T03:09:09.175066+0000","last_fullsized":"2024-09-22T03:09:09.175066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5698,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'5804","reported_seq":5841,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.141659+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:09:06.141659+0000","last_peered":"2024-09-22T03:09:06.141659+0000","last_clean":"2024-09-22T03:09:06.141659+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:09:06.141659+0000","last_undegraded":"2024-09-22T03:09:06.141659+0000","last_fullsized":"2024-09-22T03:09:06.141659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5804,"log_dups_size":0,"ondisk_log_size":5804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32178176,"num_objects":491,"num_object_clones":0,"num_object_copies":1473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5805,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'5551","reported_seq":5589,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.339543+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:09:06.339543+0000","last_peered":"2024-09-22T03:09:06.339543+0000","last_clean":"2024-09-22T03:09:06.339543+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:09:06.339543+0000","last_undegraded":"2024-09-22T03:09:06.339543+0000","last_fullsized":"2024-09-22T03:09:06.339543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5551,"log_dups_size":0,"ondisk_log_size":5551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32964632,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5552,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'5740","reported_seq":5783,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.188825+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:09:09.188825+0000","last_peered":"2024-09-22T03:09:09.188825+0000","last_clean":"2024-09-22T03:09:09.188825+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:09:09.188825+0000","last_undegraded":"2024-09-22T03:09:09.188825+0000","last_fullsized":"2024-09-22T03:09:09.188825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5740,"log_dups_size":0,"ondisk_log_size":5740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5741,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'5599","reported_seq":5636,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.264847+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:09:06.264847+0000","last_peered":"2024-09-22T03:09:06.264847+0000","last_clean":"2024-09-22T03:09:06.264847+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:09:06.264847+0000","last_undegraded":"2024-09-22T03:09:06.264847+0000","last_fullsized":"2024-09-22T03:09:06.264847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5599,"log_dups_size":0,"ondisk_log_size":5599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5600,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'5784","reported_seq":5827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.189960+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:09:09.189960+0000","last_peered":"2024-09-22T03:09:09.189960+0000","last_clean":"2024-09-22T03:09:09.189960+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:09:09.189960+0000","last_undegraded":"2024-09-22T03:09:09.189960+0000","last_fullsized":"2024-09-22T03:09:09.189960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5784,"log_dups_size":0,"ondisk_log_size":5784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34275328,"num_objects":523,"num_object_clones":0,"num_object_copies":1569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5785,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'5876","reported_seq":5919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.383105+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:09:09.383105+0000","last_peered":"2024-09-22T03:09:09.383105+0000","last_clean":"2024-09-22T03:09:09.383105+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:09:09.383105+0000","last_undegraded":"2024-09-22T03:09:09.383105+0000","last_fullsized":"2024-09-22T03:09:09.383105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5876,"log_dups_size":0,"ondisk_log_size":5876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5877,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'5677","reported_seq":5714,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.285108+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:09:06.285108+0000","last_peered":"2024-09-22T03:09:06.285108+0000","last_clean":"2024-09-22T03:09:06.285108+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:09:06.285108+0000","last_undegraded":"2024-09-22T03:09:06.285108+0000","last_fullsized":"2024-09-22T03:09:06.285108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5677,"log_dups_size":0,"ondisk_log_size":5677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5678,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'5739","reported_seq":5776,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.161338+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:09:06.161338+0000","last_peered":"2024-09-22T03:09:06.161338+0000","last_clean":"2024-09-22T03:09:06.161338+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:09:06.161338+0000","last_undegraded":"2024-09-22T03:09:06.161338+0000","last_fullsized":"2024-09-22T03:09:06.161338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5739,"log_dups_size":0,"ondisk_log_size":5739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5740,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.146035+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:09:09.146035+0000","last_peered":"2024-09-22T03:09:09.146035+0000","last_clean":"2024-09-22T03:09:09.146035+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:09:09.146035+0000","last_undegraded":"2024-09-22T03:09:09.146035+0000","last_fullsized":"2024-09-22T03:09:09.146035+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'5516","reported_seq":5553,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.391403+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:09:06.391403+0000","last_peered":"2024-09-22T03:09:06.391403+0000","last_clean":"2024-09-22T03:09:06.391403+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:09:06.391403+0000","last_undegraded":"2024-09-22T03:09:06.391403+0000","last_fullsized":"2024-09-22T03:09:06.391403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5516,"log_dups_size":0,"ondisk_log_size":5516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5517,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'5674","reported_seq":5711,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.279552+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:09:06.279552+0000","last_peered":"2024-09-22T03:09:06.279552+0000","last_clean":"2024-09-22T03:09:06.279552+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:09:06.279552+0000","last_undegraded":"2024-09-22T03:09:06.279552+0000","last_fullsized":"2024-09-22T03:09:06.279552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5674,"log_dups_size":0,"ondisk_log_size":5674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5675,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.150569+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:09:09.150569+0000","last_peered":"2024-09-22T03:09:09.150569+0000","last_clean":"2024-09-22T03:09:09.150569+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:09:09.150569+0000","last_undegraded":"2024-09-22T03:09:09.150569+0000","last_fullsized":"2024-09-22T03:09:09.150569+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'5738","reported_seq":5775,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.388628+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:09:06.388628+0000","last_peered":"2024-09-22T03:09:06.388628+0000","last_clean":"2024-09-22T03:09:06.388628+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:09:06.388628+0000","last_undegraded":"2024-09-22T03:09:06.388628+0000","last_fullsized":"2024-09-22T03:09:06.388628+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5738,"log_dups_size":0,"ondisk_log_size":5738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30867456,"num_objects":471,"num_object_clones":0,"num_object_copies":1413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5739,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'5524","reported_seq":5561,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.132446+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:09:06.132446+0000","last_peered":"2024-09-22T03:09:06.132446+0000","last_clean":"2024-09-22T03:09:06.132446+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:09:06.132446+0000","last_undegraded":"2024-09-22T03:09:06.132446+0000","last_fullsized":"2024-09-22T03:09:06.132446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5525,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'5745","reported_seq":5782,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.354409+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:09:06.354409+0000","last_peered":"2024-09-22T03:09:06.354409+0000","last_clean":"2024-09-22T03:09:06.354409+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:09:06.354409+0000","last_undegraded":"2024-09-22T03:09:06.354409+0000","last_fullsized":"2024-09-22T03:09:06.354409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5745,"log_dups_size":0,"ondisk_log_size":5745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5746,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'5620","reported_seq":5657,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.291745+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:09:06.291745+0000","last_peered":"2024-09-22T03:09:06.291745+0000","last_clean":"2024-09-22T03:09:06.291745+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:09:06.291745+0000","last_undegraded":"2024-09-22T03:09:06.291745+0000","last_fullsized":"2024-09-22T03:09:06.291745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5620,"log_dups_size":0,"ondisk_log_size":5620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5621,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'5748","reported_seq":5785,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.415500+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:09:06.415500+0000","last_peered":"2024-09-22T03:09:06.415500+0000","last_clean":"2024-09-22T03:09:06.415500+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:09:06.415500+0000","last_undegraded":"2024-09-22T03:09:06.415500+0000","last_fullsized":"2024-09-22T03:09:06.415500+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5748,"log_dups_size":0,"ondisk_log_size":5748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31522816,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5749,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":530251800,"num_objects":8092,"num_object_clones":0,"num_object_copies":24276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":91048,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99729408,"data_stored":1595473992,"data_compressed":75761637,"data_compressed_allocated":99717120,"data_compressed_original":1595473920,"omap_allocated":0,"internal_metadata":0},"log_size":91032,"ondisk_log_size":91032,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673320,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110120,"kb_used_data":29140,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94261720,"statfs":{"total":96636764160,"available":96524001280,"internally_reserved":0,"allocated":29839360,"data_stored":474024163,"data_compressed":22505983,"data_compressed_allocated":29622272,"data_compressed_original":473956352,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673320,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112712,"kb_used_data":23416,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94259128,"statfs":{"total":96636764160,"available":96521347072,"internally_reserved":0,"allocated":23977984,"data_stored":379914987,"data_compressed":18039106,"data_compressed_allocated":23744512,"data_compressed_original":379830272,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673320,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":118280,"kb_used_data":24824,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94253560,"statfs":{"total":96636764160,"available":96515645440,"internally_reserved":0,"allocated":25419776,"data_stored":402918147,"data_compressed":19131417,"data_compressed_allocated":25182208,"data_compressed_original":402833408,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111232,"kb_used_data":21932,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94260608,"statfs":{"total":96636764160,"available":96522862592,"internally_reserved":0,"allocated":22458368,"data_stored":355473337,"data_compressed":16878329,"data_compressed_allocated":22216704,"data_compressed_original":355385344,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21991424,"data_stored":351797272,"data_compressed":16705215,"data_compressed_allocated":21987328,"data_compressed_original":351797248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24887296,"data_stored":398131224,"data_compressed":18905399,"data_compressed_allocated":24883200,"data_compressed_original":398131200,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23506944,"data_stored":376111104,"data_compressed":17859768,"data_compressed_allocated":23506944,"data_compressed_original":376111104,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29343744,"data_stored":469434392,"data_compressed":22291255,"data_compressed_allocated":29339648,"data_compressed_original":469434368,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:09:11.690 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:09:11.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:11.832+0000 7ff7e786c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:11.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:11.842+0000 7ff7e786c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:12.177 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:09:12.178 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:09:12.195 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-22T03:09:11.371325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":530842187,"num_objects":8096,"num_object_clones":0,"num_object_copies":24288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":91187,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91132,"ondisk_log_size":91132,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":452344,"kb_used_data":99312,"kb_used_omap":0,"kb_used_meta":352960,"kb_avail":377035016,"statfs":{"total":386547056640,"available":386083856384,"internally_reserved":0,"allocated":101695488,"data_stored":1612330634,"data_compressed":76554835,"data_compressed_allocated":100765696,"data_compressed_original":1612005376,"omap_allocated":0,"internal_metadata":361431040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14745600,"num_objects":-225,"num_object_clones":0,"num_object_copies":-675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000700"},"pg_stats":[{"pgid":"3.f","version":"26'5697","reported_seq":5740,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.175066+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:09:09.175066+0000","last_peered":"2024-09-22T03:09:09.175066+0000","last_clean":"2024-09-22T03:09:09.175066+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:09:09.175066+0000","last_undegraded":"2024-09-22T03:09:09.175066+0000","last_fullsized":"2024-09-22T03:09:09.175066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5698,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'5804","reported_seq":5841,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.141659+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:09:06.141659+0000","last_peered":"2024-09-22T03:09:06.141659+0000","last_clean":"2024-09-22T03:09:06.141659+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:09:06.141659+0000","last_undegraded":"2024-09-22T03:09:06.141659+0000","last_fullsized":"2024-09-22T03:09:06.141659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5804,"log_dups_size":0,"ondisk_log_size":5804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32178176,"num_objects":491,"num_object_clones":0,"num_object_copies":1473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5805,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'5551","reported_seq":5589,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.339543+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:09:06.339543+0000","last_peered":"2024-09-22T03:09:06.339543+0000","last_clean":"2024-09-22T03:09:06.339543+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:09:06.339543+0000","last_undegraded":"2024-09-22T03:09:06.339543+0000","last_fullsized":"2024-09-22T03:09:06.339543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5551,"log_dups_size":0,"ondisk_log_size":5551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32964632,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5552,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'5740","reported_seq":5783,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.188825+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:09:09.188825+0000","last_peered":"2024-09-22T03:09:09.188825+0000","last_clean":"2024-09-22T03:09:09.188825+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:09:09.188825+0000","last_undegraded":"2024-09-22T03:09:09.188825+0000","last_fullsized":"2024-09-22T03:09:09.188825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5740,"log_dups_size":0,"ondisk_log_size":5740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5741,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'5599","reported_seq":5636,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.264847+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:09:06.264847+0000","last_peered":"2024-09-22T03:09:06.264847+0000","last_clean":"2024-09-22T03:09:06.264847+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:09:06.264847+0000","last_undegraded":"2024-09-22T03:09:06.264847+0000","last_fullsized":"2024-09-22T03:09:06.264847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5599,"log_dups_size":0,"ondisk_log_size":5599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5600,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'5784","reported_seq":5827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.189960+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:09:09.189960+0000","last_peered":"2024-09-22T03:09:09.189960+0000","last_clean":"2024-09-22T03:09:09.189960+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:09:09.189960+0000","last_undegraded":"2024-09-22T03:09:09.189960+0000","last_fullsized":"2024-09-22T03:09:09.189960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5784,"log_dups_size":0,"ondisk_log_size":5784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34275328,"num_objects":523,"num_object_clones":0,"num_object_copies":1569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5785,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'5876","reported_seq":5919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.383105+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:09:09.383105+0000","last_peered":"2024-09-22T03:09:09.383105+0000","last_clean":"2024-09-22T03:09:09.383105+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:09:09.383105+0000","last_undegraded":"2024-09-22T03:09:09.383105+0000","last_fullsized":"2024-09-22T03:09:09.383105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5876,"log_dups_size":0,"ondisk_log_size":5876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5877,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'5677","reported_seq":5714,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.285108+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:09:06.285108+0000","last_peered":"2024-09-22T03:09:06.285108+0000","last_clean":"2024-09-22T03:09:06.285108+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:09:06.285108+0000","last_undegraded":"2024-09-22T03:09:06.285108+0000","last_fullsized":"2024-09-22T03:09:06.285108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5677,"log_dups_size":0,"ondisk_log_size":5677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5678,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'5739","reported_seq":5776,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.161338+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:09:06.161338+0000","last_peered":"2024-09-22T03:09:06.161338+0000","last_clean":"2024-09-22T03:09:06.161338+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:09:06.161338+0000","last_undegraded":"2024-09-22T03:09:06.161338+0000","last_fullsized":"2024-09-22T03:09:06.161338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5739,"log_dups_size":0,"ondisk_log_size":5739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5740,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.146035+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:09:09.146035+0000","last_peered":"2024-09-22T03:09:09.146035+0000","last_clean":"2024-09-22T03:09:09.146035+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:09:09.146035+0000","last_undegraded":"2024-09-22T03:09:09.146035+0000","last_fullsized":"2024-09-22T03:09:09.146035+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'5516","reported_seq":5553,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.391403+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:09:06.391403+0000","last_peered":"2024-09-22T03:09:06.391403+0000","last_clean":"2024-09-22T03:09:06.391403+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:09:06.391403+0000","last_undegraded":"2024-09-22T03:09:06.391403+0000","last_fullsized":"2024-09-22T03:09:06.391403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5516,"log_dups_size":0,"ondisk_log_size":5516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5517,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'5674","reported_seq":5711,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.279552+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:09:06.279552+0000","last_peered":"2024-09-22T03:09:06.279552+0000","last_clean":"2024-09-22T03:09:06.279552+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:09:06.279552+0000","last_undegraded":"2024-09-22T03:09:06.279552+0000","last_fullsized":"2024-09-22T03:09:06.279552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5674,"log_dups_size":0,"ondisk_log_size":5674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5675,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.150569+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:09:09.150569+0000","last_peered":"2024-09-22T03:09:09.150569+0000","last_clean":"2024-09-22T03:09:09.150569+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:09:09.150569+0000","last_undegraded":"2024-09-22T03:09:09.150569+0000","last_fullsized":"2024-09-22T03:09:09.150569+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'5738","reported_seq":5775,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.388628+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:09:06.388628+0000","last_peered":"2024-09-22T03:09:06.388628+0000","last_clean":"2024-09-22T03:09:06.388628+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:09:06.388628+0000","last_undegraded":"2024-09-22T03:09:06.388628+0000","last_fullsized":"2024-09-22T03:09:06.388628+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5738,"log_dups_size":0,"ondisk_log_size":5738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30867456,"num_objects":471,"num_object_clones":0,"num_object_copies":1413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5739,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'5524","reported_seq":5561,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.132446+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:09:06.132446+0000","last_peered":"2024-09-22T03:09:06.132446+0000","last_clean":"2024-09-22T03:09:06.132446+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:09:06.132446+0000","last_undegraded":"2024-09-22T03:09:06.132446+0000","last_fullsized":"2024-09-22T03:09:06.132446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5525,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'5745","reported_seq":5782,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.354409+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:09:06.354409+0000","last_peered":"2024-09-22T03:09:06.354409+0000","last_clean":"2024-09-22T03:09:06.354409+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:09:06.354409+0000","last_undegraded":"2024-09-22T03:09:06.354409+0000","last_fullsized":"2024-09-22T03:09:06.354409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5745,"log_dups_size":0,"ondisk_log_size":5745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5746,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'5620","reported_seq":5657,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.291745+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:09:06.291745+0000","last_peered":"2024-09-22T03:09:06.291745+0000","last_clean":"2024-09-22T03:09:06.291745+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:09:06.291745+0000","last_undegraded":"2024-09-22T03:09:06.291745+0000","last_fullsized":"2024-09-22T03:09:06.291745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5620,"log_dups_size":0,"ondisk_log_size":5620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5621,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'5748","reported_seq":5785,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.415500+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:09:06.415500+0000","last_peered":"2024-09-22T03:09:06.415500+0000","last_clean":"2024-09-22T03:09:06.415500+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:09:06.415500+0000","last_undegraded":"2024-09-22T03:09:06.415500+0000","last_fullsized":"2024-09-22T03:09:06.415500+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5748,"log_dups_size":0,"ondisk_log_size":5748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31522816,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5749,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":530251800,"num_objects":8092,"num_object_clones":0,"num_object_copies":24276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":91048,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99729408,"data_stored":1595473992,"data_compressed":75761637,"data_compressed_allocated":99717120,"data_compressed_original":1595473920,"omap_allocated":0,"internal_metadata":0},"log_size":91032,"ondisk_log_size":91032,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673320,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110120,"kb_used_data":29140,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94261720,"statfs":{"total":96636764160,"available":96524001280,"internally_reserved":0,"allocated":29839360,"data_stored":474024163,"data_compressed":22505983,"data_compressed_allocated":29622272,"data_compressed_original":473956352,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673320,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112712,"kb_used_data":23416,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94259128,"statfs":{"total":96636764160,"available":96521347072,"internally_reserved":0,"allocated":23977984,"data_stored":379914987,"data_compressed":18039106,"data_compressed_allocated":23744512,"data_compressed_original":379830272,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673320,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":118280,"kb_used_data":24824,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94253560,"statfs":{"total":96636764160,"available":96515645440,"internally_reserved":0,"allocated":25419776,"data_stored":402918147,"data_compressed":19131417,"data_compressed_allocated":25182208,"data_compressed_original":402833408,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111232,"kb_used_data":21932,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94260608,"statfs":{"total":96636764160,"available":96522862592,"internally_reserved":0,"allocated":22458368,"data_stored":355473337,"data_compressed":16878329,"data_compressed_allocated":22216704,"data_compressed_original":355385344,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21991424,"data_stored":351797272,"data_compressed":16705215,"data_compressed_allocated":21987328,"data_compressed_original":351797248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24887296,"data_stored":398131224,"data_compressed":18905399,"data_compressed_allocated":24883200,"data_compressed_original":398131200,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23506944,"data_stored":376111104,"data_compressed":17859768,"data_compressed_allocated":23506944,"data_compressed_original":376111104,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29343744,"data_stored":469434392,"data_compressed":22291255,"data_compressed_allocated":29339648,"data_compressed_original":469434368,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:09:12.196 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:09:12.197 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:12.197 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:09:12.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:12.328+0000 7f7741797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:12.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:12.335+0000 7f7741797640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:12.623 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:09:12.623 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:09:12.638 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-22T03:09:11.371325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":530842187,"num_objects":8096,"num_object_clones":0,"num_object_copies":24288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":91187,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":91132,"ondisk_log_size":91132,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":452344,"kb_used_data":99312,"kb_used_omap":0,"kb_used_meta":352960,"kb_avail":377035016,"statfs":{"total":386547056640,"available":386083856384,"internally_reserved":0,"allocated":101695488,"data_stored":1612330634,"data_compressed":76554835,"data_compressed_allocated":100765696,"data_compressed_original":1612005376,"omap_allocated":0,"internal_metadata":361431040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-14745600,"num_objects":-225,"num_object_clones":0,"num_object_copies":-675,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":225,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000700"},"pg_stats":[{"pgid":"3.f","version":"26'5697","reported_seq":5740,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.175066+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:09:09.175066+0000","last_peered":"2024-09-22T03:09:09.175066+0000","last_clean":"2024-09-22T03:09:09.175066+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:09:09.175066+0000","last_undegraded":"2024-09-22T03:09:09.175066+0000","last_fullsized":"2024-09-22T03:09:09.175066+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5697,"log_dups_size":0,"ondisk_log_size":5697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31195136,"num_objects":476,"num_object_clones":0,"num_object_copies":1428,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5698,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"25'5804","reported_seq":5841,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.141659+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:09:06.141659+0000","last_peered":"2024-09-22T03:09:06.141659+0000","last_clean":"2024-09-22T03:09:06.141659+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:09:06.141659+0000","last_undegraded":"2024-09-22T03:09:06.141659+0000","last_fullsized":"2024-09-22T03:09:06.141659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5804,"log_dups_size":0,"ondisk_log_size":5804,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32178176,"num_objects":491,"num_object_clones":0,"num_object_copies":1473,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5805,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'5551","reported_seq":5589,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.339543+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:09:06.339543+0000","last_peered":"2024-09-22T03:09:06.339543+0000","last_clean":"2024-09-22T03:09:06.339543+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:09:06.339543+0000","last_undegraded":"2024-09-22T03:09:06.339543+0000","last_fullsized":"2024-09-22T03:09:06.339543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5551,"log_dups_size":0,"ondisk_log_size":5551,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32964632,"num_objects":504,"num_object_clones":0,"num_object_copies":1512,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5552,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"27'5740","reported_seq":5783,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.188825+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:09:09.188825+0000","last_peered":"2024-09-22T03:09:09.188825+0000","last_clean":"2024-09-22T03:09:09.188825+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:09:09.188825+0000","last_undegraded":"2024-09-22T03:09:09.188825+0000","last_fullsized":"2024-09-22T03:09:09.188825+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5740,"log_dups_size":0,"ondisk_log_size":5740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5741,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"25'5599","reported_seq":5636,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.264847+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:09:06.264847+0000","last_peered":"2024-09-22T03:09:06.264847+0000","last_clean":"2024-09-22T03:09:06.264847+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:09:06.264847+0000","last_undegraded":"2024-09-22T03:09:06.264847+0000","last_fullsized":"2024-09-22T03:09:06.264847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5599,"log_dups_size":0,"ondisk_log_size":5599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33947648,"num_objects":518,"num_object_clones":0,"num_object_copies":1554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5600,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'5784","reported_seq":5827,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.189960+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:09:09.189960+0000","last_peered":"2024-09-22T03:09:09.189960+0000","last_clean":"2024-09-22T03:09:09.189960+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:09:09.189960+0000","last_undegraded":"2024-09-22T03:09:09.189960+0000","last_fullsized":"2024-09-22T03:09:09.189960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5784,"log_dups_size":0,"ondisk_log_size":5784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34275328,"num_objects":523,"num_object_clones":0,"num_object_copies":1569,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5785,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"27'5876","reported_seq":5919,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.383105+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:09:09.383105+0000","last_peered":"2024-09-22T03:09:09.383105+0000","last_clean":"2024-09-22T03:09:09.383105+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:09:09.383105+0000","last_undegraded":"2024-09-22T03:09:09.383105+0000","last_fullsized":"2024-09-22T03:09:09.383105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5876,"log_dups_size":0,"ondisk_log_size":5876,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31129600,"num_objects":475,"num_object_clones":0,"num_object_copies":1425,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5877,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"25'5677","reported_seq":5714,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.285108+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:09:06.285108+0000","last_peered":"2024-09-22T03:09:06.285108+0000","last_clean":"2024-09-22T03:09:06.285108+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:09:06.285108+0000","last_undegraded":"2024-09-22T03:09:06.285108+0000","last_fullsized":"2024-09-22T03:09:06.285108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5677,"log_dups_size":0,"ondisk_log_size":5677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33423360,"num_objects":510,"num_object_clones":0,"num_object_copies":1530,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5678,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.434600+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:04:38.434600+0000","last_peered":"2024-09-22T03:04:38.434600+0000","last_clean":"2024-09-22T03:04:38.434600+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:04:38.434600+0000","last_undegraded":"2024-09-22T03:04:38.434600+0000","last_fullsized":"2024-09-22T03:04:38.434600+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"25'5739","reported_seq":5776,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.161338+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:09:06.161338+0000","last_peered":"2024-09-22T03:09:06.161338+0000","last_clean":"2024-09-22T03:09:06.161338+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:09:06.161338+0000","last_undegraded":"2024-09-22T03:09:06.161338+0000","last_fullsized":"2024-09-22T03:09:06.161338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5739,"log_dups_size":0,"ondisk_log_size":5739,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33816576,"num_objects":516,"num_object_clones":0,"num_object_copies":1548,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5740,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.146035+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:09:09.146035+0000","last_peered":"2024-09-22T03:09:09.146035+0000","last_clean":"2024-09-22T03:09:09.146035+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:09:09.146035+0000","last_undegraded":"2024-09-22T03:09:09.146035+0000","last_fullsized":"2024-09-22T03:09:09.146035+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"25'5516","reported_seq":5553,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.391403+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:09:06.391403+0000","last_peered":"2024-09-22T03:09:06.391403+0000","last_clean":"2024-09-22T03:09:06.391403+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:09:06.391403+0000","last_undegraded":"2024-09-22T03:09:06.391403+0000","last_fullsized":"2024-09-22T03:09:06.391403+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5516,"log_dups_size":0,"ondisk_log_size":5516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38600704,"num_objects":589,"num_object_clones":0,"num_object_copies":1767,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5517,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":51,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.436907+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:04:38.436907+0000","last_peered":"2024-09-22T03:04:38.436907+0000","last_clean":"2024-09-22T03:04:38.436907+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:04:38.436907+0000","last_undegraded":"2024-09-22T03:04:38.436907+0000","last_fullsized":"2024-09-22T03:04:38.436907+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"25'5674","reported_seq":5711,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.279552+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:09:06.279552+0000","last_peered":"2024-09-22T03:09:06.279552+0000","last_clean":"2024-09-22T03:09:06.279552+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:09:06.279552+0000","last_undegraded":"2024-09-22T03:09:06.279552+0000","last_fullsized":"2024-09-22T03:09:06.279552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5674,"log_dups_size":0,"ondisk_log_size":5674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32047104,"num_objects":489,"num_object_clones":0,"num_object_copies":1467,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5675,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":50,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.443501+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:04:38.443501+0000","last_peered":"2024-09-22T03:04:38.443501+0000","last_clean":"2024-09-22T03:04:38.443501+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:04:38.443501+0000","last_undegraded":"2024-09-22T03:04:38.443501+0000","last_fullsized":"2024-09-22T03:04:38.443501+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":181,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-22T03:09:09.150569+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:09:09.150569+0000","last_peered":"2024-09-22T03:09:09.150569+0000","last_clean":"2024-09-22T03:09:09.150569+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:09:09.150569+0000","last_undegraded":"2024-09-22T03:09:09.150569+0000","last_fullsized":"2024-09-22T03:09:09.150569+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"25'5738","reported_seq":5775,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.388628+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:09:06.388628+0000","last_peered":"2024-09-22T03:09:06.388628+0000","last_clean":"2024-09-22T03:09:06.388628+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:09:06.388628+0000","last_undegraded":"2024-09-22T03:09:06.388628+0000","last_fullsized":"2024-09-22T03:09:06.388628+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5738,"log_dups_size":0,"ondisk_log_size":5738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30867456,"num_objects":471,"num_object_clones":0,"num_object_copies":1413,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5739,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'5524","reported_seq":5561,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.132446+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:09:06.132446+0000","last_peered":"2024-09-22T03:09:06.132446+0000","last_clean":"2024-09-22T03:09:06.132446+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:09:06.132446+0000","last_undegraded":"2024-09-22T03:09:06.132446+0000","last_fullsized":"2024-09-22T03:09:06.132446+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5524,"log_dups_size":0,"ondisk_log_size":5524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35061760,"num_objects":535,"num_object_clones":0,"num_object_copies":1605,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5525,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.432622+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:04:38.432622+0000","last_peered":"2024-09-22T03:04:38.432622+0000","last_clean":"2024-09-22T03:04:38.432622+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:04:38.432622+0000","last_undegraded":"2024-09-22T03:04:38.432622+0000","last_fullsized":"2024-09-22T03:04:38.432622+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"25'5745","reported_seq":5782,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.354409+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:09:06.354409+0000","last_peered":"2024-09-22T03:09:06.354409+0000","last_clean":"2024-09-22T03:09:06.354409+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:09:06.354409+0000","last_undegraded":"2024-09-22T03:09:06.354409+0000","last_fullsized":"2024-09-22T03:09:06.354409+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5745,"log_dups_size":0,"ondisk_log_size":5745,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32505856,"num_objects":496,"num_object_clones":0,"num_object_copies":1488,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5746,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.440354+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:04:38.440354+0000","last_peered":"2024-09-22T03:04:38.440354+0000","last_clean":"2024-09-22T03:04:38.440354+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:04:38.440354+0000","last_undegraded":"2024-09-22T03:04:38.440354+0000","last_fullsized":"2024-09-22T03:04:38.440354+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"25'5620","reported_seq":5657,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.291745+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:09:06.291745+0000","last_peered":"2024-09-22T03:09:06.291745+0000","last_clean":"2024-09-22T03:09:06.291745+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:09:06.291745+0000","last_undegraded":"2024-09-22T03:09:06.291745+0000","last_fullsized":"2024-09-22T03:09:06.291745+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5620,"log_dups_size":0,"ondisk_log_size":5620,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35586048,"num_objects":543,"num_object_clones":0,"num_object_copies":1629,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5621,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.437615+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:04:38.437615+0000","last_peered":"2024-09-22T03:04:38.437615+0000","last_clean":"2024-09-22T03:04:38.437615+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:04:38.437615+0000","last_undegraded":"2024-09-22T03:04:38.437615+0000","last_fullsized":"2024-09-22T03:04:38.437615+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"25'5748","reported_seq":5785,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:09:06.415500+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:09:06.415500+0000","last_peered":"2024-09-22T03:09:06.415500+0000","last_clean":"2024-09-22T03:09:06.415500+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:09:06.415500+0000","last_undegraded":"2024-09-22T03:09:06.415500+0000","last_fullsized":"2024-09-22T03:09:06.415500+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5748,"log_dups_size":0,"ondisk_log_size":5748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31522816,"num_objects":481,"num_object_clones":0,"num_object_copies":1443,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5749,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":49,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-22T03:04:38.445479+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:04:38.445479+0000","last_peered":"2024-09-22T03:04:38.445479+0000","last_clean":"2024-09-22T03:04:38.445479+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:04:38.445479+0000","last_undegraded":"2024-09-22T03:04:38.445479+0000","last_fullsized":"2024-09-22T03:04:38.445479+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":530251800,"num_objects":8092,"num_object_clones":0,"num_object_copies":24276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":91048,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99729408,"data_stored":1595473992,"data_compressed":75761637,"data_compressed_allocated":99717120,"data_compressed_original":1595473920,"omap_allocated":0,"internal_metadata":0},"log_size":91032,"ondisk_log_size":91032,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673320,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110120,"kb_used_data":29140,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94261720,"statfs":{"total":96636764160,"available":96524001280,"internally_reserved":0,"allocated":29839360,"data_stored":474024163,"data_compressed":22505983,"data_compressed_allocated":29622272,"data_compressed_original":473956352,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673320,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":112712,"kb_used_data":23416,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94259128,"statfs":{"total":96636764160,"available":96521347072,"internally_reserved":0,"allocated":23977984,"data_stored":379914987,"data_compressed":18039106,"data_compressed_allocated":23744512,"data_compressed_original":379830272,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673320,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":118280,"kb_used_data":24824,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94253560,"statfs":{"total":96636764160,"available":96515645440,"internally_reserved":0,"allocated":25419776,"data_stored":402918147,"data_compressed":19131417,"data_compressed_allocated":25182208,"data_compressed_original":402833408,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111232,"kb_used_data":21932,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94260608,"statfs":{"total":96636764160,"available":96522862592,"internally_reserved":0,"allocated":22458368,"data_stored":355473337,"data_compressed":16878329,"data_compressed_allocated":22216704,"data_compressed_original":355385344,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":21991424,"data_stored":351797272,"data_compressed":16705215,"data_compressed_allocated":21987328,"data_compressed_original":351797248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24887296,"data_stored":398131224,"data_compressed":18905399,"data_compressed_allocated":24883200,"data_compressed_original":398131200,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23506944,"data_stored":376111104,"data_compressed":17859768,"data_compressed_allocated":23506944,"data_compressed_original":376111104,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29343744,"data_stored":469434392,"data_compressed":22291255,"data_compressed_allocated":29339648,"data_compressed_original":469434368,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:09:14.111 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:14.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:14.247+0000 7fc1516d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:14.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:14.253+0000 7fc1516d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:16.569 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:16.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:16.703+0000 7fc450e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:16.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:16.708+0000 7fc450e63640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:17.640 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:17.640 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:17.640 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:09:17.641 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:09:17.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:17.769+0000 7f7071afa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:17.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:17.780+0000 7f7071afa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:17.936 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:17.937 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:17.937 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:17.937 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:17.937 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:17.937 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:17.937 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:17.937 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:17.937 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:17.937 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:17.937 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:17.937 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:17.939 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:17.940 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:17.940 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:09:18.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:18.081+0000 7f8b3f2fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:18.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:18.095+0000 7f8b3f2fa640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:18.189 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:18.189 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:18.189 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:18.190 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:18.190 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:18.190 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:18.190 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:18.190 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:18.190 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:18.190 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:18.190 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:18.190 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:18.193 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:18.193 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:18.193 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:09:18.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:18.319+0000 7fecbb517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:18.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:18.330+0000 7fecbb517640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:18.362 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:18.362 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:18.362 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:18.362 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:18.362 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:18.362 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:18.363 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:18.363 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:18.363 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:18.363 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:18.363 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:18.363 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:18.366 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:18.367 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:18.367 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:09:18.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:18.501+0000 7f1565b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:18.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:18.514+0000 7f1565b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:18.568 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:18.569 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:18.569 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:18.569 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:18.569 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:18.569 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:18.569 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:18.570 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:18.570 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:18.570 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:18.570 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:18.570 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:18.572 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:18.573 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:18.973 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:19.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:19.128+0000 7ff214f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:19.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:19.137+0000 7ff214f17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:21.579 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:21.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:21.719+0000 7efcbb2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:21.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:21.724+0000 7efcbb2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:23.574 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:23.574 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:23.575 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:09:23.575 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:09:23.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:23.719+0000 7feec60c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:23.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:23.731+0000 7feec60c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:23.751 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:23.751 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:23.751 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:09:23.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:23.868+0000 7f879930e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:23.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:23.877+0000 7f879930e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:23.947 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:23.999 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:23.999 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:23.999 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:23.999 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:23.999 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:23.999 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:23.999 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:23.999 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:24.000 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:24.000 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:24.000 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:24.000 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:24.003 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:24.003 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:24.003 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:09:24.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:24.075+0000 7f90def97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:24.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:24.081+0000 7f90def97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:24.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:24.160+0000 7f4a3282c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:24.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:24.169+0000 7f4a3282c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:24.219 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:24.219 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:24.219 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:24.219 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:24.220 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:24.220 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:24.220 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:24.220 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:24.220 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:24.220 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:24.220 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:24.220 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:24.224 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:24.224 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:24.224 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:09:24.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:24.366+0000 7f0b8af03640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:24.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:24.379+0000 7f0b8af03640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:24.492 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:24.494 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:24.495 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:26.416 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:26.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:26.549+0000 7ff58ec6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:26.558+0000 7ff58ec6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:28.816 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:28.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:28.949+0000 7f672090e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:28.956+0000 7f672090e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:29.495 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:29.495 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:29.496 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:09:29.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:29.620+0000 7f4b59997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:29.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:29.627+0000 7f4b59997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:29.849 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:09:29.849 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:09:29.863 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-09-22T03:09:29.374666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":322372171,"num_objects":4915,"num_object_clones":0,"num_object_copies":14745,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":94368,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94313,"ondisk_log_size":94313,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":435952,"kb_used_data":60712,"kb_used_omap":0,"kb_used_meta":375168,"kb_avail":377051408,"statfs":{"total":386547056640,"available":386100641792,"internally_reserved":0,"allocated":62169088,"data_stored":977991249,"data_compressed":46430677,"data_compressed_allocated":61116416,"data_compressed_original":977616896,"omap_allocated":0,"internal_metadata":384172032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-111149056,"num_objects":-1696,"num_object_clones":0,"num_object_copies":-5088,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1696,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002299"},"pg_stats":[{"pgid":"3.f","version":"29'5854","reported_seq":5903,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:24.251905+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:09:24.251905+0000","last_peered":"2024-09-22T03:09:24.251905+0000","last_clean":"2024-09-22T03:09:24.251905+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:09:24.251905+0000","last_undegraded":"2024-09-22T03:09:24.251905+0000","last_fullsized":"2024-09-22T03:09:24.251905+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5854,"log_dups_size":0,"ondisk_log_size":5854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20905984,"num_objects":319,"num_object_clones":0,"num_object_copies":957,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5855,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"29'6009","reported_seq":6058,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:26.316995+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:09:26.316995+0000","last_peered":"2024-09-22T03:09:26.316995+0000","last_clean":"2024-09-22T03:09:26.316995+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:09:26.316995+0000","last_undegraded":"2024-09-22T03:09:26.316995+0000","last_fullsized":"2024-09-22T03:09:26.316995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6009,"log_dups_size":0,"ondisk_log_size":6009,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6010,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'5742","reported_seq":5792,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:26.027311+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:09:26.027311+0000","last_peered":"2024-09-22T03:09:26.027311+0000","last_clean":"2024-09-22T03:09:26.027311+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:09:26.027311+0000","last_undegraded":"2024-09-22T03:09:26.027311+0000","last_fullsized":"2024-09-22T03:09:26.027311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5742,"log_dups_size":0,"ondisk_log_size":5742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20447256,"num_objects":313,"num_object_clones":0,"num_object_copies":939,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5743,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"29'5898","reported_seq":5947,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:24.223874+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:09:24.223874+0000","last_peered":"2024-09-22T03:09:24.223874+0000","last_clean":"2024-09-22T03:09:24.223874+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:09:24.223874+0000","last_undegraded":"2024-09-22T03:09:24.223874+0000","last_fullsized":"2024-09-22T03:09:24.223874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5898,"log_dups_size":0,"ondisk_log_size":5898,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20774912,"num_objects":317,"num_object_clones":0,"num_object_copies":951,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5899,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"29'5813","reported_seq":5862,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:26.321783+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:09:26.321783+0000","last_peered":"2024-09-22T03:09:26.321783+0000","last_clean":"2024-09-22T03:09:26.321783+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:09:26.321783+0000","last_undegraded":"2024-09-22T03:09:26.321783+0000","last_fullsized":"2024-09-22T03:09:26.321783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5813,"log_dups_size":0,"ondisk_log_size":5813,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922944,"num_objects":304,"num_object_clones":0,"num_object_copies":912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5814,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"29'5966","reported_seq":6015,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:24.059869+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:09:24.059869+0000","last_peered":"2024-09-22T03:09:24.059869+0000","last_clean":"2024-09-22T03:09:24.059869+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:09:24.059869+0000","last_undegraded":"2024-09-22T03:09:24.059869+0000","last_fullsized":"2024-09-22T03:09:24.059869+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5966,"log_dups_size":0,"ondisk_log_size":5966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22347776,"num_objects":341,"num_object_clones":0,"num_object_copies":1023,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5967,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"29'6033","reported_seq":6082,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:24.278238+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:09:24.278238+0000","last_peered":"2024-09-22T03:09:24.278238+0000","last_clean":"2024-09-22T03:09:24.278238+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:09:24.278238+0000","last_undegraded":"2024-09-22T03:09:24.278238+0000","last_fullsized":"2024-09-22T03:09:24.278238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6033,"log_dups_size":0,"ondisk_log_size":6033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20840448,"num_objects":318,"num_object_clones":0,"num_object_copies":954,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6034,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'5887","reported_seq":5936,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:26.401902+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:09:26.401902+0000","last_peered":"2024-09-22T03:09:26.401902+0000","last_clean":"2024-09-22T03:09:26.401902+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:09:26.401902+0000","last_undegraded":"2024-09-22T03:09:26.401902+0000","last_fullsized":"2024-09-22T03:09:26.401902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5887,"log_dups_size":0,"ondisk_log_size":5887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19660800,"num_objects":300,"num_object_clones":0,"num_object_copies":900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5888,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.179403+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:09:11.179403+0000","last_peered":"2024-09-22T03:09:11.179403+0000","last_clean":"2024-09-22T03:09:11.179403+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:09:11.179403+0000","last_undegraded":"2024-09-22T03:09:11.179403+0000","last_fullsized":"2024-09-22T03:09:11.179403+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"29'5959","reported_seq":6008,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:26.164552+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:09:26.164552+0000","last_peered":"2024-09-22T03:09:26.164552+0000","last_clean":"2024-09-22T03:09:26.164552+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:09:26.164552+0000","last_undegraded":"2024-09-22T03:09:26.164552+0000","last_fullsized":"2024-09-22T03:09:26.164552+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5959,"log_dups_size":0,"ondisk_log_size":5959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19398656,"num_objects":296,"num_object_clones":0,"num_object_copies":888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5960,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.181534+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:09:11.181534+0000","last_peered":"2024-09-22T03:09:11.181534+0000","last_clean":"2024-09-22T03:09:11.181534+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:09:11.181534+0000","last_undegraded":"2024-09-22T03:09:11.181534+0000","last_fullsized":"2024-09-22T03:09:11.181534+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"29'5756","reported_seq":5805,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:26.383769+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:09:26.383769+0000","last_peered":"2024-09-22T03:09:26.383769+0000","last_clean":"2024-09-22T03:09:26.383769+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:09:26.383769+0000","last_undegraded":"2024-09-22T03:09:26.383769+0000","last_fullsized":"2024-09-22T03:09:26.383769+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5756,"log_dups_size":0,"ondisk_log_size":5756,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22872064,"num_objects":349,"num_object_clones":0,"num_object_copies":1047,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5757,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.160855+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:09:11.160855+0000","last_peered":"2024-09-22T03:09:11.160855+0000","last_clean":"2024-09-22T03:09:11.160855+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:09:11.160855+0000","last_undegraded":"2024-09-22T03:09:11.160855+0000","last_fullsized":"2024-09-22T03:09:11.160855+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'5877","reported_seq":5926,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:26.266548+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:09:26.266548+0000","last_peered":"2024-09-22T03:09:26.266548+0000","last_clean":"2024-09-22T03:09:26.266548+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:09:26.266548+0000","last_undegraded":"2024-09-22T03:09:26.266548+0000","last_fullsized":"2024-09-22T03:09:26.266548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5877,"log_dups_size":0,"ondisk_log_size":5877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18743296,"num_objects":286,"num_object_clones":0,"num_object_copies":858,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5878,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.195631+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:09:11.195631+0000","last_peered":"2024-09-22T03:09:11.195631+0000","last_clean":"2024-09-22T03:09:11.195631+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:09:11.195631+0000","last_undegraded":"2024-09-22T03:09:11.195631+0000","last_fullsized":"2024-09-22T03:09:11.195631+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.207966+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:09:11.207966+0000","last_peered":"2024-09-22T03:09:11.207966+0000","last_clean":"2024-09-22T03:09:11.207966+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:09:11.207966+0000","last_undegraded":"2024-09-22T03:09:11.207966+0000","last_fullsized":"2024-09-22T03:09:11.207966+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"29'5929","reported_seq":5978,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:26.194983+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:09:26.194983+0000","last_peered":"2024-09-22T03:09:26.194983+0000","last_clean":"2024-09-22T03:09:26.194983+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:09:26.194983+0000","last_undegraded":"2024-09-22T03:09:26.194983+0000","last_fullsized":"2024-09-22T03:09:26.194983+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5929,"log_dups_size":0,"ondisk_log_size":5929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18350080,"num_objects":280,"num_object_clones":0,"num_object_copies":840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5930,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'5738","reported_seq":5787,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:26.370845+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:09:26.370845+0000","last_peered":"2024-09-22T03:09:26.370845+0000","last_clean":"2024-09-22T03:09:26.370845+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:09:26.370845+0000","last_undegraded":"2024-09-22T03:09:26.370845+0000","last_fullsized":"2024-09-22T03:09:26.370845+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5738,"log_dups_size":0,"ondisk_log_size":5738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21037056,"num_objects":321,"num_object_clones":0,"num_object_copies":963,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5739,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.182945+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:09:11.182945+0000","last_peered":"2024-09-22T03:09:11.182945+0000","last_clean":"2024-09-22T03:09:11.182945+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:09:11.182945+0000","last_undegraded":"2024-09-22T03:09:11.182945+0000","last_fullsized":"2024-09-22T03:09:11.182945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"29'5946","reported_seq":5995,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:26.344248+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:09:26.344248+0000","last_peered":"2024-09-22T03:09:26.344248+0000","last_clean":"2024-09-22T03:09:26.344248+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:09:26.344248+0000","last_undegraded":"2024-09-22T03:09:26.344248+0000","last_fullsized":"2024-09-22T03:09:26.344248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5946,"log_dups_size":0,"ondisk_log_size":5946,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19333120,"num_objects":295,"num_object_clones":0,"num_object_copies":885,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5947,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.162652+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:09:11.162652+0000","last_peered":"2024-09-22T03:09:11.162652+0000","last_clean":"2024-09-22T03:09:11.162652+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:09:11.162652+0000","last_undegraded":"2024-09-22T03:09:11.162652+0000","last_fullsized":"2024-09-22T03:09:11.162652+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"29'5856","reported_seq":5905,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:25.966250+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:09:25.966250+0000","last_peered":"2024-09-22T03:09:25.966250+0000","last_clean":"2024-09-22T03:09:25.966250+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:09:25.966250+0000","last_undegraded":"2024-09-22T03:09:25.966250+0000","last_fullsized":"2024-09-22T03:09:25.966250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5856,"log_dups_size":0,"ondisk_log_size":5856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20119552,"num_objects":307,"num_object_clones":0,"num_object_copies":921,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5857,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.210620+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:09:11.210620+0000","last_peered":"2024-09-22T03:09:11.210620+0000","last_clean":"2024-09-22T03:09:11.210620+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:09:11.210620+0000","last_undegraded":"2024-09-22T03:09:11.210620+0000","last_fullsized":"2024-09-22T03:09:11.210620+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'5950","reported_seq":5999,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:26.292360+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:09:26.292360+0000","last_peered":"2024-09-22T03:09:26.292360+0000","last_clean":"2024-09-22T03:09:26.292360+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:09:26.292360+0000","last_undegraded":"2024-09-22T03:09:26.292360+0000","last_fullsized":"2024-09-22T03:09:26.292360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5950,"log_dups_size":0,"ondisk_log_size":5950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18284544,"num_objects":279,"num_object_clones":0,"num_object_copies":837,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5951,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.186405+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:09:11.186405+0000","last_peered":"2024-09-22T03:09:11.186405+0000","last_clean":"2024-09-22T03:09:11.186405+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:09:11.186405+0000","last_undegraded":"2024-09-22T03:09:11.186405+0000","last_fullsized":"2024-09-22T03:09:11.186405+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":321781784,"num_objects":4911,"num_object_clones":0,"num_object_copies":14733,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":94229,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":60170240,"data_stored":962527304,"data_compressed":45705943,"data_compressed_allocated":60157952,"data_compressed_original":962527232,"omap_allocated":0,"internal_metadata":0},"log_size":94213,"ondisk_log_size":94213,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":128792,"kb_used_data":17280,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94243048,"statfs":{"total":96636764160,"available":96504881152,"internally_reserved":0,"allocated":17694720,"data_stored":279198727,"data_compressed":13254008,"data_compressed_allocated":17444864,"data_compressed_original":279117824,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98984,"kb_used_data":13848,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94272856,"statfs":{"total":96636764160,"available":96535404544,"internally_reserved":0,"allocated":14180352,"data_stored":222641679,"data_compressed":10570306,"data_compressed_allocated":13914112,"data_compressed_original":222543872,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673340,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99960,"kb_used_data":14824,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94271880,"statfs":{"total":96636764160,"available":96534405120,"internally_reserved":0,"allocated":15179776,"data_stored":238566951,"data_compressed":11326522,"data_compressed_allocated":14909440,"data_compressed_original":238469120,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108216,"kb_used_data":14760,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94263624,"statfs":{"total":96636764160,"available":96525950976,"internally_reserved":0,"allocated":15114240,"data_stored":237583892,"data_compressed":11279841,"data_compressed_allocated":14848000,"data_compressed_original":237486080,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":234815512,"data_compressed":11150295,"data_compressed_allocated":14675968,"data_compressed_original":234815488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14610432,"data_stored":233701400,"data_compressed":11097392,"data_compressed_allocated":14606336,"data_compressed_original":233701376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":13664256,"data_stored":218628096,"data_compressed":10381632,"data_compressed_allocated":13664256,"data_compressed_original":218628096,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":17215488,"data_stored":275382296,"data_compressed":13076624,"data_compressed_allocated":17211392,"data_compressed_original":275382272,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:09:31.296 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:31.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:31.426+0000 7f0417458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:31.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:31.432+0000 7f0417458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:33.823 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:33.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:33.967+0000 7f949506c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:33.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:33.975+0000 7f949506c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:34.866 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:34.866 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:34.866 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:09:34.866 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:09:35.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:35.000+0000 7f5efd397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:35.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:35.009+0000 7f5efd397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:35.187 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:35.188 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:35.188 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:35.188 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:35.188 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:35.188 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:35.188 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:35.188 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:35.188 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:35.188 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:35.188 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:35.188 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:35.192 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:35.192 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:35.194 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:09:35.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:35.332+0000 7f2fd1b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:35.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:35.344+0000 7f2fd1b17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:35.449 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:35.449 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:35.449 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:35.449 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:35.449 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:35.449 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:35.449 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:35.449 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:35.449 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:35.450 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:35.450 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:35.450 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:35.453 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:35.454 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:35.454 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:09:35.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:35.587+0000 7f2088623640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:35.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:35.596+0000 7f2088623640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:35.668 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:35.668 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:35.668 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:35.668 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:35.668 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:35.668 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:35.669 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:35.669 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:35.669 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:35.669 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:35.669 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:35.669 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:35.672 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:35.672 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:35.673 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:09:35.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:35.815+0000 7f7c22197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:35.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:35.824+0000 7f7c22197640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:35.848 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:35.848 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:35.848 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:35.848 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:35.848 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:35.848 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:35.848 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:35.848 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:35.848 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:35.848 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:35.848 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:35.849 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:35.852 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:35.852 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:36.476 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:36.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:36.618+0000 7f6e53757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:36.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:36.623+0000 7f6e53757640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:38.928 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:39.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:39.063+0000 7f8a5066c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:39.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:39.069+0000 7f8a5066c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:40.853 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:40.853 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:40.854 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:09:40.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:40.985+0000 7fbea2a23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:40.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:40.995+0000 7fbea2a23640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:41.299 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:09:41.299 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:09:41.313 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2024-09-22T03:09:39.376532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":211354187,"num_objects":3221,"num_object_clones":0,"num_object_copies":9663,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":96062,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96007,"ondisk_log_size":96007,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":403224,"kb_used_data":40472,"kb_used_omap":0,"kb_used_meta":362688,"kb_avail":377084136,"statfs":{"total":386547056640,"available":386134155264,"internally_reserved":0,"allocated":41443328,"data_stored":646379089,"data_compressed":30683958,"data_compressed_allocated":40390656,"data_compressed_original":646004736,"omap_allocated":0,"internal_metadata":371392512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-111017984,"num_objects":-1694,"num_object_clones":0,"num_object_copies":-5082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1694,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002238"},"pg_stats":[{"pgid":"3.f","version":"29'5964","reported_seq":6013,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:34.356785+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:09:34.356785+0000","last_peered":"2024-09-22T03:09:34.356785+0000","last_clean":"2024-09-22T03:09:34.356785+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:09:34.356785+0000","last_undegraded":"2024-09-22T03:09:34.356785+0000","last_fullsized":"2024-09-22T03:09:34.356785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5964,"log_dups_size":0,"ondisk_log_size":5964,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13697024,"num_objects":209,"num_object_clones":0,"num_object_copies":627,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5965,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"29'6095","reported_seq":6144,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:36.386279+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:09:36.386279+0000","last_peered":"2024-09-22T03:09:36.386279+0000","last_clean":"2024-09-22T03:09:36.386279+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:09:36.386279+0000","last_undegraded":"2024-09-22T03:09:36.386279+0000","last_fullsized":"2024-09-22T03:09:36.386279+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6095,"log_dups_size":0,"ondisk_log_size":6095,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13107200,"num_objects":200,"num_object_clones":0,"num_object_copies":600,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6096,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'5849","reported_seq":5899,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:35.744055+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:09:35.744055+0000","last_peered":"2024-09-22T03:09:35.744055+0000","last_clean":"2024-09-22T03:09:35.744055+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:09:35.744055+0000","last_undegraded":"2024-09-22T03:09:35.744055+0000","last_fullsized":"2024-09-22T03:09:35.744055+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5849,"log_dups_size":0,"ondisk_log_size":5849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13434904,"num_objects":206,"num_object_clones":0,"num_object_copies":618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5850,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"29'6011","reported_seq":6060,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:34.294678+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:09:34.294678+0000","last_peered":"2024-09-22T03:09:34.294678+0000","last_clean":"2024-09-22T03:09:34.294678+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:09:34.294678+0000","last_undegraded":"2024-09-22T03:09:34.294678+0000","last_fullsized":"2024-09-22T03:09:34.294678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6011,"log_dups_size":0,"ondisk_log_size":6011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6012,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"29'5916","reported_seq":5965,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:36.178551+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:09:36.178551+0000","last_peered":"2024-09-22T03:09:36.178551+0000","last_clean":"2024-09-22T03:09:36.178551+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:09:36.178551+0000","last_undegraded":"2024-09-22T03:09:36.178551+0000","last_fullsized":"2024-09-22T03:09:36.178551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5916,"log_dups_size":0,"ondisk_log_size":5916,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13172736,"num_objects":201,"num_object_clones":0,"num_object_copies":603,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5917,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"29'6093","reported_seq":6142,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:34.181989+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:09:34.181989+0000","last_peered":"2024-09-22T03:09:34.181989+0000","last_clean":"2024-09-22T03:09:34.181989+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:09:34.181989+0000","last_undegraded":"2024-09-22T03:09:34.181989+0000","last_fullsized":"2024-09-22T03:09:34.181989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6093,"log_dups_size":0,"ondisk_log_size":6093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14024704,"num_objects":214,"num_object_clones":0,"num_object_copies":642,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6094,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"29'6128","reported_seq":6177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:34.366193+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:09:34.366193+0000","last_peered":"2024-09-22T03:09:34.366193+0000","last_clean":"2024-09-22T03:09:34.366193+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:09:34.366193+0000","last_undegraded":"2024-09-22T03:09:34.366193+0000","last_fullsized":"2024-09-22T03:09:34.366193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6128,"log_dups_size":0,"ondisk_log_size":6128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14614528,"num_objects":223,"num_object_clones":0,"num_object_copies":669,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6129,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'5996","reported_seq":6045,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:36.322527+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:09:36.322527+0000","last_peered":"2024-09-22T03:09:36.322527+0000","last_clean":"2024-09-22T03:09:36.322527+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:09:36.322527+0000","last_undegraded":"2024-09-22T03:09:36.322527+0000","last_fullsized":"2024-09-22T03:09:36.322527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5996,"log_dups_size":0,"ondisk_log_size":5996,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12517376,"num_objects":191,"num_object_clones":0,"num_object_copies":573,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5997,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.179403+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:09:11.179403+0000","last_peered":"2024-09-22T03:09:11.179403+0000","last_clean":"2024-09-22T03:09:11.179403+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:09:11.179403+0000","last_undegraded":"2024-09-22T03:09:11.179403+0000","last_fullsized":"2024-09-22T03:09:11.179403+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"29'6059","reported_seq":6108,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:36.365405+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:09:36.365405+0000","last_peered":"2024-09-22T03:09:36.365405+0000","last_clean":"2024-09-22T03:09:36.365405+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:09:36.365405+0000","last_undegraded":"2024-09-22T03:09:36.365405+0000","last_fullsized":"2024-09-22T03:09:36.365405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6059,"log_dups_size":0,"ondisk_log_size":6059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12845056,"num_objects":196,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6060,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.181534+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:09:11.181534+0000","last_peered":"2024-09-22T03:09:11.181534+0000","last_clean":"2024-09-22T03:09:11.181534+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:09:11.181534+0000","last_undegraded":"2024-09-22T03:09:11.181534+0000","last_fullsized":"2024-09-22T03:09:11.181534+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"29'5879","reported_seq":5928,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:36.230690+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:09:36.230690+0000","last_peered":"2024-09-22T03:09:36.230690+0000","last_clean":"2024-09-22T03:09:36.230690+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:09:36.230690+0000","last_undegraded":"2024-09-22T03:09:36.230690+0000","last_fullsized":"2024-09-22T03:09:36.230690+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5879,"log_dups_size":0,"ondisk_log_size":5879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14811136,"num_objects":226,"num_object_clones":0,"num_object_copies":678,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5880,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.160855+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:09:11.160855+0000","last_peered":"2024-09-22T03:09:11.160855+0000","last_clean":"2024-09-22T03:09:11.160855+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:09:11.160855+0000","last_undegraded":"2024-09-22T03:09:11.160855+0000","last_fullsized":"2024-09-22T03:09:11.160855+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'5990","reported_seq":6039,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:36.432175+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:09:36.432175+0000","last_peered":"2024-09-22T03:09:36.432175+0000","last_clean":"2024-09-22T03:09:36.432175+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:09:36.432175+0000","last_undegraded":"2024-09-22T03:09:36.432175+0000","last_fullsized":"2024-09-22T03:09:36.432175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5990,"log_dups_size":0,"ondisk_log_size":5990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11337728,"num_objects":173,"num_object_clones":0,"num_object_copies":519,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5991,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.195631+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:09:11.195631+0000","last_peered":"2024-09-22T03:09:11.195631+0000","last_clean":"2024-09-22T03:09:11.195631+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:09:11.195631+0000","last_undegraded":"2024-09-22T03:09:11.195631+0000","last_fullsized":"2024-09-22T03:09:11.195631+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.207966+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:09:11.207966+0000","last_peered":"2024-09-22T03:09:11.207966+0000","last_clean":"2024-09-22T03:09:11.207966+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:09:11.207966+0000","last_undegraded":"2024-09-22T03:09:11.207966+0000","last_fullsized":"2024-09-22T03:09:11.207966+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"29'6025","reported_seq":6074,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:36.359727+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:09:36.359727+0000","last_peered":"2024-09-22T03:09:36.359727+0000","last_clean":"2024-09-22T03:09:36.359727+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:09:36.359727+0000","last_undegraded":"2024-09-22T03:09:36.359727+0000","last_fullsized":"2024-09-22T03:09:36.359727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6025,"log_dups_size":0,"ondisk_log_size":6025,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12058624,"num_objects":184,"num_object_clones":0,"num_object_copies":552,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6026,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'5855","reported_seq":5904,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:36.285561+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:09:36.285561+0000","last_peered":"2024-09-22T03:09:36.285561+0000","last_clean":"2024-09-22T03:09:36.285561+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:09:36.285561+0000","last_undegraded":"2024-09-22T03:09:36.285561+0000","last_fullsized":"2024-09-22T03:09:36.285561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5855,"log_dups_size":0,"ondisk_log_size":5855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13369344,"num_objects":204,"num_object_clones":0,"num_object_copies":612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5856,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.182945+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:09:11.182945+0000","last_peered":"2024-09-22T03:09:11.182945+0000","last_clean":"2024-09-22T03:09:11.182945+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:09:11.182945+0000","last_undegraded":"2024-09-22T03:09:11.182945+0000","last_fullsized":"2024-09-22T03:09:11.182945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"29'6049","reported_seq":6098,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:36.358943+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:09:36.358943+0000","last_peered":"2024-09-22T03:09:36.358943+0000","last_clean":"2024-09-22T03:09:36.358943+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:09:36.358943+0000","last_undegraded":"2024-09-22T03:09:36.358943+0000","last_fullsized":"2024-09-22T03:09:36.358943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6049,"log_dups_size":0,"ondisk_log_size":6049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":192,"num_object_clones":0,"num_object_copies":576,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6050,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.162652+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:09:11.162652+0000","last_peered":"2024-09-22T03:09:11.162652+0000","last_clean":"2024-09-22T03:09:11.162652+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:09:11.162652+0000","last_undegraded":"2024-09-22T03:09:11.162652+0000","last_fullsized":"2024-09-22T03:09:11.162652+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"29'5965","reported_seq":6014,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:36.167440+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:09:36.167440+0000","last_peered":"2024-09-22T03:09:36.167440+0000","last_clean":"2024-09-22T03:09:36.167440+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:09:36.167440+0000","last_undegraded":"2024-09-22T03:09:36.167440+0000","last_fullsized":"2024-09-22T03:09:36.167440+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5965,"log_dups_size":0,"ondisk_log_size":5965,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12976128,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5966,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.210620+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:09:11.210620+0000","last_peered":"2024-09-22T03:09:11.210620+0000","last_clean":"2024-09-22T03:09:11.210620+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:09:11.210620+0000","last_undegraded":"2024-09-22T03:09:11.210620+0000","last_fullsized":"2024-09-22T03:09:11.210620+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'6033","reported_seq":6082,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:36.019287+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:09:36.019287+0000","last_peered":"2024-09-22T03:09:36.019287+0000","last_clean":"2024-09-22T03:09:36.019287+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:09:36.019287+0000","last_undegraded":"2024-09-22T03:09:36.019287+0000","last_fullsized":"2024-09-22T03:09:36.019287+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6033,"log_dups_size":0,"ondisk_log_size":6033,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12845056,"num_objects":196,"num_object_clones":0,"num_object_copies":588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6034,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.186405+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:09:11.186405+0000","last_peered":"2024-09-22T03:09:11.186405+0000","last_clean":"2024-09-22T03:09:11.186405+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:09:11.186405+0000","last_undegraded":"2024-09-22T03:09:11.186405+0000","last_fullsized":"2024-09-22T03:09:11.186405+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":210763800,"num_objects":3217,"num_object_clones":0,"num_object_copies":9651,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":95923,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":39510016,"data_stored":631963720,"data_compressed":30009016,"data_compressed_allocated":39497728,"data_compressed_original":631963648,"omap_allocated":0,"internal_metadata":0},"log_size":95907,"ondisk_log_size":95907,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673350,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":110472,"kb_used_data":11448,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94261368,"statfs":{"total":96636764160,"available":96523640832,"internally_reserved":0,"allocated":11722752,"data_stored":183647239,"data_compressed":8716712,"data_compressed_allocated":11472896,"data_compressed_original":183566336,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673350,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98444,"kb_used_data":9148,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94273396,"statfs":{"total":96636764160,"available":96535957504,"internally_reserved":0,"allocated":9367552,"data_stored":145636879,"data_compressed":6913706,"data_compressed_allocated":9101312,"data_compressed_original":145539072,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673350,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99136,"kb_used_data":9840,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94272704,"statfs":{"total":96636764160,"available":96535248896,"internally_reserved":0,"allocated":10076160,"data_stored":156909095,"data_compressed":7448970,"data_compressed_allocated":9805824,"data_compressed_original":156811264,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706053,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":95172,"kb_used_data":10036,"kb_used_omap":0,"kb_used_meta":85120,"kb_avail":94276668,"statfs":{"total":96636764160,"available":96539308032,"internally_reserved":0,"allocated":10276864,"data_stored":160185876,"data_compressed":7604570,"data_compressed_allocated":10010624,"data_compressed_original":160088064,"omap_allocated":0,"internal_metadata":87162880},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9805824,"data_stored":156827672,"data_compressed":7447016,"data_compressed_allocated":9801728,"data_compressed_original":156827648,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9560064,"data_stored":152895512,"data_compressed":7260296,"data_compressed_allocated":9555968,"data_compressed_original":152895488,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8888320,"data_stored":142213120,"data_compressed":6753040,"data_compressed_allocated":8888320,"data_compressed_original":142213120,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11255808,"data_stored":180027416,"data_compressed":8548664,"data_compressed_allocated":11251712,"data_compressed_original":180027392,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:09:41.329 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:41.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:41.455+0000 7f8d8e597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:41.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:41.464+0000 7f8d8e597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:43.927 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:44.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:44.069+0000 7fb2282ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:44.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:44.079+0000 7fb2282ce640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:46.314 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:46.314 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:46.315 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:09:46.429 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:46.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:46.439+0000 7f5326d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:46.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:46.450+0000 7f5326d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:46.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:46.576+0000 7f7283658640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:46.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:46.583+0000 7f7283658640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:46.738 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:09:46.738 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:09:46.754 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-09-22T03:09:45.377684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":143131211,"num_objects":2180,"num_object_clones":0,"num_object_copies":6540,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":97103,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97048,"ondisk_log_size":97048,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":403296,"kb_used_data":28060,"kb_used_omap":0,"kb_used_meta":375168,"kb_avail":377084064,"statfs":{"total":386547056640,"available":386134081536,"internally_reserved":0,"allocated":28733440,"data_stored":443020881,"data_compressed":21027422,"data_compressed_allocated":27680768,"data_compressed_original":442646528,"omap_allocated":0,"internal_metadata":384172032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-123928576,"num_objects":-1891,"num_object_clones":0,"num_object_copies":-5673,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1891,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002357"},"pg_stats":[{"pgid":"3.f","version":"29'6065","reported_seq":6114,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:44.337228+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:09:44.337228+0000","last_peered":"2024-09-22T03:09:44.337228+0000","last_clean":"2024-09-22T03:09:44.337228+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:09:44.337228+0000","last_undegraded":"2024-09-22T03:09:44.337228+0000","last_fullsized":"2024-09-22T03:09:44.337228+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6065,"log_dups_size":0,"ondisk_log_size":6065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7077888,"num_objects":108,"num_object_clones":0,"num_object_copies":324,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6066,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"29'6145","reported_seq":6194,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:41.416461+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:09:41.416461+0000","last_peered":"2024-09-22T03:09:41.416461+0000","last_clean":"2024-09-22T03:09:41.416461+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:09:41.416461+0000","last_undegraded":"2024-09-22T03:09:41.416461+0000","last_fullsized":"2024-09-22T03:09:41.416461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6145,"log_dups_size":0,"ondisk_log_size":6145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9830400,"num_objects":150,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6146,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'5909","reported_seq":5959,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:41.216664+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:09:41.216664+0000","last_peered":"2024-09-22T03:09:41.216664+0000","last_clean":"2024-09-22T03:09:41.216664+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:09:41.216664+0000","last_undegraded":"2024-09-22T03:09:41.216664+0000","last_fullsized":"2024-09-22T03:09:41.216664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5909,"log_dups_size":0,"ondisk_log_size":5909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502744,"num_objects":146,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5910,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"29'6108","reported_seq":6157,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:44.128035+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:09:44.128035+0000","last_peered":"2024-09-22T03:09:44.128035+0000","last_clean":"2024-09-22T03:09:44.128035+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:09:44.128035+0000","last_undegraded":"2024-09-22T03:09:44.128035+0000","last_fullsized":"2024-09-22T03:09:44.128035+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6108,"log_dups_size":0,"ondisk_log_size":6108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6109,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"29'5972","reported_seq":6021,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:41.356848+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:09:41.356848+0000","last_peered":"2024-09-22T03:09:41.356848+0000","last_clean":"2024-09-22T03:09:41.356848+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:09:41.356848+0000","last_undegraded":"2024-09-22T03:09:41.356848+0000","last_fullsized":"2024-09-22T03:09:41.356848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5972,"log_dups_size":0,"ondisk_log_size":5972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9502720,"num_objects":145,"num_object_clones":0,"num_object_copies":435,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5973,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"29'6195","reported_seq":6244,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:44.262634+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:09:44.262634+0000","last_peered":"2024-09-22T03:09:44.262634+0000","last_clean":"2024-09-22T03:09:44.262634+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:09:44.262634+0000","last_undegraded":"2024-09-22T03:09:44.262634+0000","last_fullsized":"2024-09-22T03:09:44.262634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6195,"log_dups_size":0,"ondisk_log_size":6195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":112,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6196,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"29'6240","reported_seq":6289,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:44.262501+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:09:44.262501+0000","last_peered":"2024-09-22T03:09:44.262501+0000","last_clean":"2024-09-22T03:09:44.262501+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:09:44.262501+0000","last_undegraded":"2024-09-22T03:09:44.262501+0000","last_fullsized":"2024-09-22T03:09:44.262501+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6240,"log_dups_size":0,"ondisk_log_size":6240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274496,"num_objects":111,"num_object_clones":0,"num_object_copies":333,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6241,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'6038","reported_seq":6087,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:41.316864+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:09:41.316864+0000","last_peered":"2024-09-22T03:09:41.316864+0000","last_clean":"2024-09-22T03:09:41.316864+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:09:41.316864+0000","last_undegraded":"2024-09-22T03:09:41.316864+0000","last_fullsized":"2024-09-22T03:09:41.316864+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6038,"log_dups_size":0,"ondisk_log_size":6038,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6039,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.179403+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:09:11.179403+0000","last_peered":"2024-09-22T03:09:11.179403+0000","last_clean":"2024-09-22T03:09:11.179403+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:09:11.179403+0000","last_undegraded":"2024-09-22T03:09:11.179403+0000","last_fullsized":"2024-09-22T03:09:11.179403+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"29'6117","reported_seq":6166,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:41.413399+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:09:41.413399+0000","last_peered":"2024-09-22T03:09:41.413399+0000","last_clean":"2024-09-22T03:09:41.413399+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:09:41.413399+0000","last_undegraded":"2024-09-22T03:09:41.413399+0000","last_fullsized":"2024-09-22T03:09:41.413399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6117,"log_dups_size":0,"ondisk_log_size":6117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6118,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.181534+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:09:11.181534+0000","last_peered":"2024-09-22T03:09:11.181534+0000","last_clean":"2024-09-22T03:09:11.181534+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:09:11.181534+0000","last_undegraded":"2024-09-22T03:09:11.181534+0000","last_fullsized":"2024-09-22T03:09:11.181534+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"29'5938","reported_seq":5987,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:41.239536+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:09:41.239536+0000","last_peered":"2024-09-22T03:09:41.239536+0000","last_clean":"2024-09-22T03:09:41.239536+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:09:41.239536+0000","last_undegraded":"2024-09-22T03:09:41.239536+0000","last_fullsized":"2024-09-22T03:09:41.239536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5938,"log_dups_size":0,"ondisk_log_size":5938,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10944512,"num_objects":167,"num_object_clones":0,"num_object_copies":501,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5939,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.160855+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:09:11.160855+0000","last_peered":"2024-09-22T03:09:11.160855+0000","last_clean":"2024-09-22T03:09:11.160855+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:09:11.160855+0000","last_undegraded":"2024-09-22T03:09:11.160855+0000","last_fullsized":"2024-09-22T03:09:11.160855+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'6034","reported_seq":6083,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:40.957261+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:09:40.957261+0000","last_peered":"2024-09-22T03:09:40.957261+0000","last_clean":"2024-09-22T03:09:40.957261+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:09:40.957261+0000","last_undegraded":"2024-09-22T03:09:40.957261+0000","last_fullsized":"2024-09-22T03:09:40.957261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6034,"log_dups_size":0,"ondisk_log_size":6034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8454144,"num_objects":129,"num_object_clones":0,"num_object_copies":387,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6035,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.195631+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:09:11.195631+0000","last_peered":"2024-09-22T03:09:11.195631+0000","last_clean":"2024-09-22T03:09:11.195631+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:09:11.195631+0000","last_undegraded":"2024-09-22T03:09:11.195631+0000","last_fullsized":"2024-09-22T03:09:11.195631+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.207966+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:09:11.207966+0000","last_peered":"2024-09-22T03:09:11.207966+0000","last_clean":"2024-09-22T03:09:11.207966+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:09:11.207966+0000","last_undegraded":"2024-09-22T03:09:11.207966+0000","last_fullsized":"2024-09-22T03:09:11.207966+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"29'6071","reported_seq":6120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:41.335562+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:09:41.335562+0000","last_peered":"2024-09-22T03:09:41.335562+0000","last_clean":"2024-09-22T03:09:41.335562+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:09:41.335562+0000","last_undegraded":"2024-09-22T03:09:41.335562+0000","last_fullsized":"2024-09-22T03:09:41.335562+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6071,"log_dups_size":0,"ondisk_log_size":6071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9043968,"num_objects":138,"num_object_clones":0,"num_object_copies":414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6072,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'5911","reported_seq":5960,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:41.358358+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:09:41.358358+0000","last_peered":"2024-09-22T03:09:41.358358+0000","last_clean":"2024-09-22T03:09:41.358358+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:09:41.358358+0000","last_undegraded":"2024-09-22T03:09:41.358358+0000","last_fullsized":"2024-09-22T03:09:41.358358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5911,"log_dups_size":0,"ondisk_log_size":5911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699328,"num_objects":148,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5912,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.182945+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:09:11.182945+0000","last_peered":"2024-09-22T03:09:11.182945+0000","last_clean":"2024-09-22T03:09:11.182945+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:09:11.182945+0000","last_undegraded":"2024-09-22T03:09:11.182945+0000","last_fullsized":"2024-09-22T03:09:11.182945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"29'6106","reported_seq":6155,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:41.305166+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:09:41.305166+0000","last_peered":"2024-09-22T03:09:41.305166+0000","last_clean":"2024-09-22T03:09:41.305166+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:09:41.305166+0000","last_undegraded":"2024-09-22T03:09:41.305166+0000","last_fullsized":"2024-09-22T03:09:41.305166+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6106,"log_dups_size":0,"ondisk_log_size":6106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8847360,"num_objects":135,"num_object_clones":0,"num_object_copies":405,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6107,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.162652+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:09:11.162652+0000","last_peered":"2024-09-22T03:09:11.162652+0000","last_clean":"2024-09-22T03:09:11.162652+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:09:11.162652+0000","last_undegraded":"2024-09-22T03:09:11.162652+0000","last_fullsized":"2024-09-22T03:09:11.162652+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"29'6014","reported_seq":6063,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:41.448400+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:09:41.448400+0000","last_peered":"2024-09-22T03:09:41.448400+0000","last_clean":"2024-09-22T03:09:41.448400+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:09:41.448400+0000","last_undegraded":"2024-09-22T03:09:41.448400+0000","last_fullsized":"2024-09-22T03:09:41.448400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6014,"log_dups_size":0,"ondisk_log_size":6014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9764864,"num_objects":149,"num_object_clones":0,"num_object_copies":447,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6015,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.210620+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:09:11.210620+0000","last_peered":"2024-09-22T03:09:11.210620+0000","last_clean":"2024-09-22T03:09:11.210620+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:09:11.210620+0000","last_undegraded":"2024-09-22T03:09:11.210620+0000","last_fullsized":"2024-09-22T03:09:11.210620+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'6085","reported_seq":6134,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:41.267918+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:09:41.267918+0000","last_peered":"2024-09-22T03:09:41.267918+0000","last_clean":"2024-09-22T03:09:41.267918+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:09:41.267918+0000","last_undegraded":"2024-09-22T03:09:41.267918+0000","last_fullsized":"2024-09-22T03:09:41.267918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6085,"log_dups_size":0,"ondisk_log_size":6085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":144,"num_object_clones":0,"num_object_copies":432,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6086,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.186405+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:09:11.186405+0000","last_peered":"2024-09-22T03:09:11.186405+0000","last_clean":"2024-09-22T03:09:11.186405+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:09:11.186405+0000","last_undegraded":"2024-09-22T03:09:11.186405+0000","last_fullsized":"2024-09-22T03:09:11.186405+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":142540824,"num_objects":2176,"num_object_clones":0,"num_object_copies":6528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":96964,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":26857472,"data_stored":429523016,"data_compressed":20396048,"data_compressed_allocated":26845184,"data_compressed_original":429522944,"omap_allocated":0,"internal_metadata":0},"log_size":96948,"ondisk_log_size":96948,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673355,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111704,"kb_used_data":8520,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94260136,"statfs":{"total":96636764160,"available":96522379264,"internally_reserved":0,"allocated":8724480,"data_stored":135674887,"data_compressed":6438728,"data_compressed_allocated":8474624,"data_compressed_original":135593984,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673355,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":96180,"kb_used_data":6884,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94275660,"statfs":{"total":96636764160,"available":96538275840,"internally_reserved":0,"allocated":7049216,"data_stored":108543503,"data_compressed":5152314,"data_compressed_allocated":6782976,"data_compressed_original":108445696,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673355,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":100796,"kb_used_data":7336,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94271044,"statfs":{"total":96636764160,"available":96533549056,"internally_reserved":0,"allocated":7512064,"data_stored":115883559,"data_compressed":5500858,"data_compressed_allocated":7241728,"data_compressed_original":115785728,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706063,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":94616,"kb_used_data":5320,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94277224,"statfs":{"total":96636764160,"available":96539877376,"internally_reserved":0,"allocated":5447680,"data_stored":82918932,"data_compressed":3935522,"data_compressed_allocated":5181440,"data_compressed_original":82821120,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5025792,"data_stored":80347160,"data_compressed":3815312,"data_compressed_allocated":5021696,"data_compressed_original":80347136,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6995968,"data_stored":111869976,"data_compressed":5312184,"data_compressed_allocated":6991872,"data_compressed_original":111869952,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6574080,"data_stored":105185280,"data_compressed":4994760,"data_compressed_allocated":6574080,"data_compressed_original":105185280,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8261632,"data_stored":132120600,"data_compressed":6273792,"data_compressed_allocated":8257536,"data_compressed_original":132120576,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:09:48.914 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:49.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:49.051+0000 7fd59e62c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:49.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:49.056+0000 7fd59e62c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:51.289 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:51.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:51.430+0000 7fa560597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:51.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:51.436+0000 7fa560597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:51.756 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:51.757 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:51.757 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:09:51.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:51.893+0000 7f58a62a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:51.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:51.903+0000 7f58a62a9640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:52.170 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:09:52.170 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:09:52.184 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-09-22T03:09:51.378712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88867403,"num_objects":1352,"num_object_clones":0,"num_object_copies":4056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":92,"num_write":97931,"num_write_kb":3174313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97876,"ondisk_log_size":97876,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":397636,"kb_used_data":18236,"kb_used_omap":0,"kb_used_meta":379328,"kb_avail":377089724,"statfs":{"total":386547056640,"available":386139877376,"internally_reserved":0,"allocated":18673664,"data_stored":282064465,"data_compressed":13384350,"data_compressed_allocated":17620992,"data_compressed_original":281690112,"omap_allocated":0,"internal_metadata":388431872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-122486784,"num_objects":-1869,"num_object_clones":0,"num_object_copies":-5607,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1869,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002179"},"pg_stats":[{"pgid":"3.f","version":"29'6129","reported_seq":6178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:49.380314+0000","last_change":"2024-09-22T03:03:19.461519+0000","last_active":"2024-09-22T03:09:49.380314+0000","last_peered":"2024-09-22T03:09:49.380314+0000","last_clean":"2024-09-22T03:09:49.380314+0000","last_became_active":"2024-09-22T03:03:19.458640+0000","last_became_peered":"2024-09-22T03:03:19.458640+0000","last_unstale":"2024-09-22T03:09:49.380314+0000","last_undegraded":"2024-09-22T03:09:49.380314+0000","last_fullsized":"2024-09-22T03:09:49.380314+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6129,"log_dups_size":0,"ondisk_log_size":6129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2883584,"num_objects":44,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6130,"num_write_kb":197568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"29'6188","reported_seq":6237,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:46.297062+0000","last_change":"2024-09-22T03:03:19.460980+0000","last_active":"2024-09-22T03:09:46.297062+0000","last_peered":"2024-09-22T03:09:46.297062+0000","last_clean":"2024-09-22T03:09:46.297062+0000","last_became_active":"2024-09-22T03:03:19.453916+0000","last_became_peered":"2024-09-22T03:03:19.453916+0000","last_unstale":"2024-09-22T03:09:46.297062+0000","last_undegraded":"2024-09-22T03:09:46.297062+0000","last_fullsized":"2024-09-22T03:09:46.297062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6188,"log_dups_size":0,"ondisk_log_size":6188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7012352,"num_objects":107,"num_object_clones":0,"num_object_copies":321,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6189,"num_write_kb":201472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'5967","reported_seq":6017,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:46.288312+0000","last_change":"2024-09-22T03:03:19.498655+0000","last_active":"2024-09-22T03:09:46.288312+0000","last_peered":"2024-09-22T03:09:46.288312+0000","last_clean":"2024-09-22T03:09:46.288312+0000","last_became_active":"2024-09-22T03:03:19.494724+0000","last_became_peered":"2024-09-22T03:03:19.494724+0000","last_unstale":"2024-09-22T03:09:46.288312+0000","last_undegraded":"2024-09-22T03:09:46.288312+0000","last_fullsized":"2024-09-22T03:09:46.288312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5967,"log_dups_size":0,"ondisk_log_size":5967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5701656,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5968,"num_write_kb":193729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"29'6159","reported_seq":6208,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:49.300914+0000","last_change":"2024-09-22T03:03:19.456133+0000","last_active":"2024-09-22T03:09:49.300914+0000","last_peered":"2024-09-22T03:09:49.300914+0000","last_clean":"2024-09-22T03:09:49.300914+0000","last_became_active":"2024-09-22T03:03:19.452704+0000","last_became_peered":"2024-09-22T03:03:19.452704+0000","last_unstale":"2024-09-22T03:09:49.300914+0000","last_undegraded":"2024-09-22T03:09:49.300914+0000","last_fullsized":"2024-09-22T03:09:49.300914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6159,"log_dups_size":0,"ondisk_log_size":6159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3670016,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6160,"num_write_kb":198912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"29'6027","reported_seq":6076,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:46.411146+0000","last_change":"2024-09-22T03:03:19.487972+0000","last_active":"2024-09-22T03:09:46.411146+0000","last_peered":"2024-09-22T03:09:46.411146+0000","last_clean":"2024-09-22T03:09:46.411146+0000","last_became_active":"2024-09-22T03:03:19.480422+0000","last_became_peered":"2024-09-22T03:03:19.480422+0000","last_unstale":"2024-09-22T03:09:46.411146+0000","last_undegraded":"2024-09-22T03:09:46.411146+0000","last_fullsized":"2024-09-22T03:09:46.411146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6027,"log_dups_size":0,"ondisk_log_size":6027,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5898240,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6028,"num_write_kb":195776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"29'6248","reported_seq":6297,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:49.170336+0000","last_change":"2024-09-22T03:03:19.456357+0000","last_active":"2024-09-22T03:09:49.170336+0000","last_peered":"2024-09-22T03:09:49.170336+0000","last_clean":"2024-09-22T03:09:49.170336+0000","last_became_active":"2024-09-22T03:03:19.452040+0000","last_became_peered":"2024-09-22T03:03:19.452040+0000","last_unstale":"2024-09-22T03:09:49.170336+0000","last_undegraded":"2024-09-22T03:09:49.170336+0000","last_fullsized":"2024-09-22T03:09:49.170336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6248,"log_dups_size":0,"ondisk_log_size":6248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3866624,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6249,"num_write_kb":201856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"29'6287","reported_seq":6336,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:49.057576+0000","last_change":"2024-09-22T03:03:19.468157+0000","last_active":"2024-09-22T03:09:49.057576+0000","last_peered":"2024-09-22T03:09:49.057576+0000","last_clean":"2024-09-22T03:09:49.057576+0000","last_became_active":"2024-09-22T03:03:19.465053+0000","last_became_peered":"2024-09-22T03:03:19.465053+0000","last_unstale":"2024-09-22T03:09:49.057576+0000","last_undegraded":"2024-09-22T03:09:49.057576+0000","last_fullsized":"2024-09-22T03:09:49.057576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6287,"log_dups_size":0,"ondisk_log_size":6287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6288,"num_write_kb":203264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"29'6083","reported_seq":6132,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:46.155820+0000","last_change":"2024-09-22T03:03:19.451465+0000","last_active":"2024-09-22T03:09:46.155820+0000","last_peered":"2024-09-22T03:09:46.155820+0000","last_clean":"2024-09-22T03:09:46.155820+0000","last_became_active":"2024-09-22T03:03:19.448176+0000","last_became_peered":"2024-09-22T03:03:19.448176+0000","last_unstale":"2024-09-22T03:09:46.155820+0000","last_undegraded":"2024-09-22T03:09:46.155820+0000","last_fullsized":"2024-09-22T03:09:46.155820+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6083,"log_dups_size":0,"ondisk_log_size":6083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6815744,"num_objects":104,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6084,"num_write_kb":198016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.179403+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:09:11.179403+0000","last_peered":"2024-09-22T03:09:11.179403+0000","last_clean":"2024-09-22T03:09:11.179403+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:09:11.179403+0000","last_undegraded":"2024-09-22T03:09:11.179403+0000","last_fullsized":"2024-09-22T03:09:11.179403+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"29'6164","reported_seq":6213,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:46.359509+0000","last_change":"2024-09-22T03:03:19.506777+0000","last_active":"2024-09-22T03:09:46.359509+0000","last_peered":"2024-09-22T03:09:46.359509+0000","last_clean":"2024-09-22T03:09:46.359509+0000","last_became_active":"2024-09-22T03:03:19.502648+0000","last_became_peered":"2024-09-22T03:03:19.502648+0000","last_unstale":"2024-09-22T03:09:46.359509+0000","last_undegraded":"2024-09-22T03:09:46.359509+0000","last_fullsized":"2024-09-22T03:09:46.359509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6164,"log_dups_size":0,"ondisk_log_size":6164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5963776,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6165,"num_write_kb":200192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.181534+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:09:11.181534+0000","last_peered":"2024-09-22T03:09:11.181534+0000","last_clean":"2024-09-22T03:09:11.181534+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:09:11.181534+0000","last_undegraded":"2024-09-22T03:09:11.181534+0000","last_fullsized":"2024-09-22T03:09:11.181534+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"29'6003","reported_seq":6052,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:46.143920+0000","last_change":"2024-09-22T03:03:19.457118+0000","last_active":"2024-09-22T03:09:46.143920+0000","last_peered":"2024-09-22T03:09:46.143920+0000","last_clean":"2024-09-22T03:09:46.143920+0000","last_became_active":"2024-09-22T03:03:19.452541+0000","last_became_peered":"2024-09-22T03:03:19.452541+0000","last_unstale":"2024-09-22T03:09:46.143920+0000","last_undegraded":"2024-09-22T03:09:46.143920+0000","last_fullsized":"2024-09-22T03:09:46.143920+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6003,"log_dups_size":0,"ondisk_log_size":6003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6684672,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6004,"num_write_kb":195392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.160855+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:09:11.160855+0000","last_peered":"2024-09-22T03:09:11.160855+0000","last_clean":"2024-09-22T03:09:11.160855+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:09:11.160855+0000","last_undegraded":"2024-09-22T03:09:11.160855+0000","last_fullsized":"2024-09-22T03:09:11.160855+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'6082","reported_seq":6131,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:46.062903+0000","last_change":"2024-09-22T03:03:19.469600+0000","last_active":"2024-09-22T03:09:46.062903+0000","last_peered":"2024-09-22T03:09:46.062903+0000","last_clean":"2024-09-22T03:09:46.062903+0000","last_became_active":"2024-09-22T03:03:19.461580+0000","last_became_peered":"2024-09-22T03:03:19.461580+0000","last_unstale":"2024-09-22T03:09:46.062903+0000","last_undegraded":"2024-09-22T03:09:46.062903+0000","last_fullsized":"2024-09-22T03:09:46.062903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6082,"log_dups_size":0,"ondisk_log_size":6082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308416,"num_objects":81,"num_object_clones":0,"num_object_copies":243,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6083,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.195631+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:09:11.195631+0000","last_peered":"2024-09-22T03:09:11.195631+0000","last_clean":"2024-09-22T03:09:11.195631+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:09:11.195631+0000","last_undegraded":"2024-09-22T03:09:11.195631+0000","last_fullsized":"2024-09-22T03:09:11.195631+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":187,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.207966+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:09:11.207966+0000","last_peered":"2024-09-22T03:09:11.207966+0000","last_clean":"2024-09-22T03:09:11.207966+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:09:11.207966+0000","last_undegraded":"2024-09-22T03:09:11.207966+0000","last_fullsized":"2024-09-22T03:09:11.207966+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"29'6125","reported_seq":6174,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:46.464797+0000","last_change":"2024-09-22T03:03:19.484116+0000","last_active":"2024-09-22T03:09:46.464797+0000","last_peered":"2024-09-22T03:09:46.464797+0000","last_clean":"2024-09-22T03:09:46.464797+0000","last_became_active":"2024-09-22T03:03:19.476423+0000","last_became_peered":"2024-09-22T03:03:19.476423+0000","last_unstale":"2024-09-22T03:09:46.464797+0000","last_undegraded":"2024-09-22T03:09:46.464797+0000","last_fullsized":"2024-09-22T03:09:46.464797+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6125,"log_dups_size":0,"ondisk_log_size":6125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505024,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6126,"num_write_kb":198720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'5960","reported_seq":6009,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:46.358226+0000","last_change":"2024-09-22T03:03:19.477363+0000","last_active":"2024-09-22T03:09:46.358226+0000","last_peered":"2024-09-22T03:09:46.358226+0000","last_clean":"2024-09-22T03:09:46.358226+0000","last_became_active":"2024-09-22T03:03:19.469941+0000","last_became_peered":"2024-09-22T03:03:19.469941+0000","last_unstale":"2024-09-22T03:09:46.358226+0000","last_undegraded":"2024-09-22T03:09:46.358226+0000","last_fullsized":"2024-09-22T03:09:46.358226+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":5960,"log_dups_size":0,"ondisk_log_size":5960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6488064,"num_objects":99,"num_object_clones":0,"num_object_copies":297,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5961,"num_write_kb":193920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.182945+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:09:11.182945+0000","last_peered":"2024-09-22T03:09:11.182945+0000","last_clean":"2024-09-22T03:09:11.182945+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:09:11.182945+0000","last_undegraded":"2024-09-22T03:09:11.182945+0000","last_fullsized":"2024-09-22T03:09:11.182945+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"29'6143","reported_seq":6192,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:46.015571+0000","last_change":"2024-09-22T03:03:19.467315+0000","last_active":"2024-09-22T03:09:46.015571+0000","last_peered":"2024-09-22T03:09:46.015571+0000","last_clean":"2024-09-22T03:09:46.015571+0000","last_became_active":"2024-09-22T03:03:19.460431+0000","last_became_peered":"2024-09-22T03:03:19.460431+0000","last_unstale":"2024-09-22T03:09:46.015571+0000","last_undegraded":"2024-09-22T03:09:46.015571+0000","last_fullsized":"2024-09-22T03:09:46.015571+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6143,"log_dups_size":0,"ondisk_log_size":6143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6144,"num_write_kb":199744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.162652+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:09:11.162652+0000","last_peered":"2024-09-22T03:09:11.162652+0000","last_clean":"2024-09-22T03:09:11.162652+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:09:11.162652+0000","last_undegraded":"2024-09-22T03:09:11.162652+0000","last_fullsized":"2024-09-22T03:09:11.162652+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"29'6080","reported_seq":6129,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:46.282444+0000","last_change":"2024-09-22T03:03:19.463862+0000","last_active":"2024-09-22T03:09:46.282444+0000","last_peered":"2024-09-22T03:09:46.282444+0000","last_clean":"2024-09-22T03:09:46.282444+0000","last_became_active":"2024-09-22T03:03:19.458303+0000","last_became_peered":"2024-09-22T03:03:19.458303+0000","last_unstale":"2024-09-22T03:09:46.282444+0000","last_undegraded":"2024-09-22T03:09:46.282444+0000","last_fullsized":"2024-09-22T03:09:46.282444+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6080,"log_dups_size":0,"ondisk_log_size":6080,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5439488,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6081,"num_write_kb":197248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.210620+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:09:11.210620+0000","last_peered":"2024-09-22T03:09:11.210620+0000","last_clean":"2024-09-22T03:09:11.210620+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:09:11.210620+0000","last_undegraded":"2024-09-22T03:09:11.210620+0000","last_fullsized":"2024-09-22T03:09:11.210620+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'6131","reported_seq":6180,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:46.371096+0000","last_change":"2024-09-22T03:03:19.467473+0000","last_active":"2024-09-22T03:09:46.371096+0000","last_peered":"2024-09-22T03:09:46.371096+0000","last_clean":"2024-09-22T03:09:46.371096+0000","last_became_active":"2024-09-22T03:03:19.462977+0000","last_became_peered":"2024-09-22T03:03:19.462977+0000","last_unstale":"2024-09-22T03:09:46.371096+0000","last_undegraded":"2024-09-22T03:09:46.371096+0000","last_fullsized":"2024-09-22T03:09:46.371096+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:18.369514+0000","last_clean_scrub_stamp":"2024-09-22T03:03:18.369514+0000","objects_scrubbed":0,"log_size":6131,"log_dups_size":0,"ondisk_log_size":6131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6422528,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6132,"num_write_kb":199360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-22T03:09:11.186405+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:09:11.186405+0000","last_peered":"2024-09-22T03:09:11.186405+0000","last_clean":"2024-09-22T03:09:11.186405+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:09:11.186405+0000","last_undegraded":"2024-09-22T03:09:11.186405+0000","last_fullsized":"2024-09-22T03:09:11.186405+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":88277016,"num_objects":1348,"num_object_clones":0,"num_object_copies":4044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":97792,"num_write_kb":3172417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16781312,"data_stored":268304456,"data_compressed":12740528,"data_compressed_allocated":16769024,"data_compressed_original":268304384,"omap_allocated":0,"internal_metadata":0},"log_size":97776,"ondisk_log_size":97776,"up":48,"acting":48,"num_store_stats":4},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673360,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":108804,"kb_used_data":5620,"kb_used_omap":0,"kb_used_meta":103168,"kb_avail":94263036,"statfs":{"total":96636764160,"available":96525348864,"internally_reserved":0,"allocated":5754880,"data_stored":88161287,"data_compressed":4182528,"data_compressed_allocated":5505024,"data_compressed_original":88080384,"omap_allocated":0,"internal_metadata":105644032},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673360,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98060,"kb_used_data":4600,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94273780,"statfs":{"total":96636764160,"available":96536350720,"internally_reserved":0,"allocated":4710400,"data_stored":71122447,"data_compressed":3375362,"data_compressed_allocated":4444160,"data_compressed_original":71024640,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673360,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":98432,"kb_used_data":4976,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94273408,"statfs":{"total":96636764160,"available":96535969792,"internally_reserved":0,"allocated":5095424,"data_stored":77217319,"data_compressed":3664778,"data_compressed_allocated":4825088,"data_compressed_original":77119488,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706068,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":92340,"kb_used_data":3040,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94279500,"statfs":{"total":96636764160,"available":96542208000,"internally_reserved":0,"allocated":3112960,"data_stored":45563412,"data_compressed":2161682,"data_compressed_allocated":2846720,"data_compressed_original":45465600,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":2691072,"data_stored":42991640,"data_compressed":2041472,"data_compressed_allocated":2686976,"data_compressed_original":42991616,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4583424,"data_stored":73269272,"data_compressed":3479216,"data_compressed_allocated":4579328,"data_compressed_original":73269248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4218880,"data_stored":67502080,"data_compressed":3205360,"data_compressed_allocated":4218880,"data_compressed_original":67502080,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5287936,"data_stored":84541464,"data_compressed":4014480,"data_compressed_allocated":5283840,"data_compressed_original":84541440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:09:53.828 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:53.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:53.949+0000 7f640e397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:53.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:53.957+0000 7f640e397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:55.328 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Removed 49569 objects 2024-09-22T03:09:55.328 INFO:tasks.radosbench.radosbench.0.smithi145.stdout:Clean up completed and total clean up time :243.816 2024-09-22T03:09:56.198 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-22T03:09:56.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:56.303+0000 7fb4f5f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:56.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:56.307+0000 7fb4f5f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:57.185 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3] 2024-09-22T03:09:57.186 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.00 2024-09-22T03:09:57.186 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-22T03:09:57.186 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-09-22T03:09:57.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:57.286+0000 7f21ffa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:57.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:57.294+0000 7f21ffa6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:57.307 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:57.308 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:57.308 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:57.308 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:57.308 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:57.308 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:57.308 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:57.308 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:57.308 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:57.308 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:57.308 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:57.308 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:57.311 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:57.311 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:57.311 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-22T03:09:57.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:57.408+0000 7f87b2557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:57.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:57.416+0000 7f87b2557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:57.430 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:57.430 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:57.430 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:57.430 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:57.430 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:57.430 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:57.430 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:57.430 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:57.430 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:57.431 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:57.431 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:57.431 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:57.433 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:57.433 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:57.433 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-22T03:09:57.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:57.533+0000 7f8e01d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:57.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:57.540+0000 7f8e01d0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:57.555 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:57.556 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:57.556 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:57.556 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:57.556 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:57.556 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:57.556 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:57.556 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:57.556 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:57.556 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:57.556 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:57.556 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:57.558 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:57.559 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:57.559 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-22T03:09:57.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:57.656+0000 7f981cd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:57.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:57.663+0000 7f981cd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:57.678 INFO:teuthology.orchestra.run.smithi145.stderr:no valid command found; 10 closest matches: 2024-09-22T03:09:57.678 INFO:teuthology.orchestra.run.smithi145.stderr:config get 2024-09-22T03:09:57.678 INFO:teuthology.orchestra.run.smithi145.stderr:config help 2024-09-22T03:09:57.678 INFO:teuthology.orchestra.run.smithi145.stderr:config set ... 2024-09-22T03:09:57.678 INFO:teuthology.orchestra.run.smithi145.stderr:config show 2024-09-22T03:09:57.679 INFO:teuthology.orchestra.run.smithi145.stderr:deep_scrub 2024-09-22T03:09:57.679 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_ops 2024-09-22T03:09:57.679 INFO:teuthology.orchestra.run.smithi145.stderr:dump_historic_slow_ops 2024-09-22T03:09:57.679 INFO:teuthology.orchestra.run.smithi145.stderr:dump_metrics [] 2024-09-22T03:09:57.679 INFO:teuthology.orchestra.run.smithi145.stderr:dump_ops_in_flight 2024-09-22T03:09:57.679 INFO:teuthology.orchestra.run.smithi145.stderr:dump_pgstate_history 2024-09-22T03:09:57.679 INFO:teuthology.orchestra.run.smithi145.stderr:Error EINVAL: invalid command 2024-09-22T03:09:57.681 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-22T03:09:57.681 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-22T03:09:58.381 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-22T03:09:58.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:58.483+0000 7f682db17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:58.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:58.487+0000 7f682db17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:58.751 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-09-22T03:09:58.751 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-09-22T03:09:58.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:58.849+0000 7f0d9c157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:58.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:09:58.860+0000 7f0d9c157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:09:59.134 INFO:teuthology.orchestra.run.smithi145.stderr:pool 'unique_pool_0' removed 2024-09-22T03:09:59.150 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-22T03:09:59.165 INFO:tasks.thrashosds:joining thrashosds 2024-09-22T03:10:02.682 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-22T03:10:02.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:02.797+0000 7f8688663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:02.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:02.803+0000 7f8688663640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:02.818 INFO:teuthology.orchestra.run.smithi145.stdout:{} 2024-09-22T03:10:02.818 INFO:teuthology.orchestra.run.smithi145.stderr:mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-22T03:10:02.829 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-22T03:10:02.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:02.929+0000 7f6c6ee2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:02.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:02.938+0000 7f6c6ee2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:03.440 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.0 to 1 (10000) 2024-09-22T03:10:03.456 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-22T03:10:03.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:03.555+0000 7f7939157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:03.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:03.564+0000 7f7939157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:04.440 INFO:teuthology.orchestra.run.smithi145.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-22T03:10:04.457 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-22T03:10:04.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:04.564+0000 7f03f1d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:04.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:04.573+0000 7f03f1d17640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:05.454 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.1 to 1 (10000) 2024-09-22T03:10:05.472 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-22T03:10:05.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:05.571+0000 7f313f557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:05.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:05.579+0000 7f313f557640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:06.455 INFO:teuthology.orchestra.run.smithi145.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-22T03:10:06.473 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-22T03:10:06.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:06.572+0000 7f91d8717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:06.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:06.580+0000 7f91d8717640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:07.462 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.2 to 1 (10000) 2024-09-22T03:10:07.481 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-22T03:10:07.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:07.582+0000 7f8f76b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:07.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:07.591+0000 7f8f76b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:08.468 INFO:teuthology.orchestra.run.smithi145.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-22T03:10:08.487 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-22T03:10:08.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:08.587+0000 7f5447997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:08.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:08.596+0000 7f5447997640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:09.473 INFO:teuthology.orchestra.run.smithi145.stderr:reweighted osd.3 to 1 (10000) 2024-09-22T03:10:09.491 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-22T03:10:09.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:09.592+0000 7f6922397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:09.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:09.601+0000 7f6922397640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:10.477 INFO:teuthology.orchestra.run.smithi145.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-22T03:10:10.494 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-22T03:10:10.495 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-22T03:10:10.495 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:10:10.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:10.594+0000 7f439266c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:10.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:10.600+0000 7f439266c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:10.780 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:10:10.780 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":38,"fsid":"110716e9-1590-4d11-aa79-697b4ec9a4b0","created":"2024-09-22T03:02:57.063974+0000","modified":"2024-09-22T03:10:10.475328+0000","last_up_change":"2024-09-22T03:03:05.317100+0000","last_in_change":"2024-09-22T03:02:59.144490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-22T03:03:07.249906+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-09-22T03:03:07.334071+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d85fcc9-e5d4-4463-8465-afb150e1d595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2286030306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6801","nonce":2286030306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":2286030306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2286030306}]},"public_addr":"172.21.15.145:6802/2286030306","cluster_addr":"172.21.15.145:6801/2286030306","heartbeat_back_addr":"172.21.15.145:6805/2286030306","heartbeat_front_addr":"172.21.15.145:6806/2286030306","state":["exists","up"]},{"osd":1,"uuid":"89ec4223-137c-4451-b184-e334dd762925","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3284590914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":3284590914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":3284590914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":3284590914}]},"public_addr":"172.21.15.145:6804/3284590914","cluster_addr":"172.21.15.145:6803/3284590914","heartbeat_back_addr":"172.21.15.145:6814/3284590914","heartbeat_front_addr":"172.21.15.145:6813/3284590914","state":["exists","up"]},{"osd":2,"uuid":"d0346c80-1ff5-42a1-a9fe-82ff81bbd91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":792102490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":792102490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":792102490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6807","nonce":792102490}]},"public_addr":"172.21.15.194:6804/792102490","cluster_addr":"172.21.15.194:6805/792102490","heartbeat_back_addr":"172.21.15.194:6808/792102490","heartbeat_front_addr":"172.21.15.194:6807/792102490","state":["exists","up"]},{"osd":3,"uuid":"974b2daf-1154-410d-a87f-c085313352a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6803","nonce":2433098210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2433098210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":2433098210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2433098210}]},"public_addr":"172.21.15.194:6803/2433098210","cluster_addr":"172.21.15.194:6802/2433098210","heartbeat_back_addr":"172.21.15.194:6811/2433098210","heartbeat_front_addr":"172.21.15.194:6810/2433098210","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:10:10.793 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-22T03:10:10.794 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:10:10.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:10.892+0000 7f6b57b0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:10.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:10.899+0000 7f6b57b0e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.075 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:10:11.076 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":38,"fsid":"110716e9-1590-4d11-aa79-697b4ec9a4b0","created":"2024-09-22T03:02:57.063974+0000","modified":"2024-09-22T03:10:10.475328+0000","last_up_change":"2024-09-22T03:03:05.317100+0000","last_in_change":"2024-09-22T03:02:59.144490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-22T03:03:07.249906+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-09-22T03:03:07.334071+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d85fcc9-e5d4-4463-8465-afb150e1d595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2286030306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6801","nonce":2286030306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":2286030306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2286030306}]},"public_addr":"172.21.15.145:6802/2286030306","cluster_addr":"172.21.15.145:6801/2286030306","heartbeat_back_addr":"172.21.15.145:6805/2286030306","heartbeat_front_addr":"172.21.15.145:6806/2286030306","state":["exists","up"]},{"osd":1,"uuid":"89ec4223-137c-4451-b184-e334dd762925","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3284590914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":3284590914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":3284590914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":3284590914}]},"public_addr":"172.21.15.145:6804/3284590914","cluster_addr":"172.21.15.145:6803/3284590914","heartbeat_back_addr":"172.21.15.145:6814/3284590914","heartbeat_front_addr":"172.21.15.145:6813/3284590914","state":["exists","up"]},{"osd":2,"uuid":"d0346c80-1ff5-42a1-a9fe-82ff81bbd91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":792102490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":792102490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":792102490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6807","nonce":792102490}]},"public_addr":"172.21.15.194:6804/792102490","cluster_addr":"172.21.15.194:6805/792102490","heartbeat_back_addr":"172.21.15.194:6808/792102490","heartbeat_front_addr":"172.21.15.194:6807/792102490","state":["exists","up"]},{"osd":3,"uuid":"974b2daf-1154-410d-a87f-c085313352a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6803","nonce":2433098210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2433098210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":2433098210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2433098210}]},"public_addr":"172.21.15.194:6803/2433098210","cluster_addr":"172.21.15.194:6802/2433098210","heartbeat_back_addr":"172.21.15.194:6811/2433098210","heartbeat_front_addr":"172.21.15.194:6810/2433098210","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:10:11.089 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-22T03:10:11.089 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-22T03:10:11.089 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-22T03:10:11.090 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-22T03:10:11.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.199+0000 7f1f18b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.199+0000 7f1cc4157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.209+0000 7f1cc4157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.211+0000 7f1f18b97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.245 INFO:teuthology.orchestra.run.smithi145.stdout:42949673385 2024-09-22T03:10:11.246 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-22T03:10:11.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.241+0000 7fad91117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.252 INFO:teuthology.orchestra.run.smithi145.stdout:38654706090 2024-09-22T03:10:11.252 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-22T03:10:11.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.250+0000 7fad91117640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.245+0000 7f9d71d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.255+0000 7f9d71d57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.283 INFO:teuthology.orchestra.run.smithi145.stdout:42949673385 2024-09-22T03:10:11.283 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-22T03:10:11.289 INFO:teuthology.orchestra.run.smithi145.stdout:42949673385 2024-09-22T03:10:11.289 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-22T03:10:11.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.363+0000 7fc18ea6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.372+0000 7fc18ea6c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.369+0000 7f857e62c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.386+0000 7f857e62c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.451+0000 7f69d54ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.459+0000 7f69d54ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.458+0000 7efddf157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.471+0000 7efddf157640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.657 INFO:teuthology.orchestra.run.smithi145.stdout:42949673385 2024-09-22T03:10:11.672 INFO:teuthology.orchestra.run.smithi145.stdout:42949673385 2024-09-22T03:10:11.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673385 got 42949673385 for osd.3 2024-09-22T03:10:11.674 DEBUG:teuthology.parallel:result is None 2024-09-22T03:10:11.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673385 got 42949673385 for osd.1 2024-09-22T03:10:11.690 DEBUG:teuthology.parallel:result is None 2024-09-22T03:10:11.749 INFO:teuthology.orchestra.run.smithi145.stdout:38654706090 2024-09-22T03:10:11.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654706090 got 38654706090 for osd.0 2024-09-22T03:10:11.767 DEBUG:teuthology.parallel:result is None 2024-09-22T03:10:11.813 INFO:teuthology.orchestra.run.smithi145.stdout:42949673385 2024-09-22T03:10:11.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673385 got 42949673385 for osd.2 2024-09-22T03:10:11.826 DEBUG:teuthology.parallel:result is None 2024-09-22T03:10:11.826 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-22T03:10:11.827 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:11.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.927+0000 7f00b7a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:11.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:11.934+0000 7f00b7a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:12.119 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:10:12.119 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:10:12.131 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-22T03:10:11.382749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":386400,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":384896,"kb_avail":377100960,"statfs":{"total":386547056640,"available":386151383040,"internally_reserved":0,"allocated":1474560,"data_stored":2201149,"data_compressed":89886,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":394133504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000731"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.483477+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:10:10.483477+0000","last_peered":"2024-09-22T03:10:10.483477+0000","last_clean":"2024-09-22T03:10:10.483477+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:10:10.483477+0000","last_undegraded":"2024-09-22T03:10:10.483477+0000","last_fullsized":"2024-09-22T03:10:10.483477+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.483305+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:10:10.483305+0000","last_peered":"2024-09-22T03:10:10.483305+0000","last_clean":"2024-09-22T03:10:10.483305+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:10:10.483305+0000","last_undegraded":"2024-09-22T03:10:10.483305+0000","last_fullsized":"2024-09-22T03:10:10.483305+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":90,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.482471+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:10:10.482471+0000","last_peered":"2024-09-22T03:10:10.482471+0000","last_clean":"2024-09-22T03:10:10.482471+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:10:10.482471+0000","last_undegraded":"2024-09-22T03:10:10.482471+0000","last_fullsized":"2024-09-22T03:10:10.482471+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":89,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485016+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:10:10.485016+0000","last_peered":"2024-09-22T03:10:10.485016+0000","last_clean":"2024-09-22T03:10:10.485016+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:10:10.485016+0000","last_undegraded":"2024-09-22T03:10:10.485016+0000","last_fullsized":"2024-09-22T03:10:10.485016+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":214,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.484836+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:10:10.484836+0000","last_peered":"2024-09-22T03:10:10.484836+0000","last_clean":"2024-09-22T03:10:10.484836+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:10:10.484836+0000","last_undegraded":"2024-09-22T03:10:10.484836+0000","last_fullsized":"2024-09-22T03:10:10.484836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.484328+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:10:10.484328+0000","last_peered":"2024-09-22T03:10:10.484328+0000","last_clean":"2024-09-22T03:10:10.484328+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:10:10.484328+0000","last_undegraded":"2024-09-22T03:10:10.484328+0000","last_fullsized":"2024-09-22T03:10:10.484328+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485177+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:10:10.485177+0000","last_peered":"2024-09-22T03:10:10.485177+0000","last_clean":"2024-09-22T03:10:10.485177+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:10:10.485177+0000","last_undegraded":"2024-09-22T03:10:10.485177+0000","last_fullsized":"2024-09-22T03:10:10.485177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485777+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:10:10.485777+0000","last_peered":"2024-09-22T03:10:10.485777+0000","last_clean":"2024-09-22T03:10:10.485777+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:10:10.485777+0000","last_undegraded":"2024-09-22T03:10:10.485777+0000","last_fullsized":"2024-09-22T03:10:10.485777+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485610+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:10:10.485610+0000","last_peered":"2024-09-22T03:10:10.485610+0000","last_clean":"2024-09-22T03:10:10.485610+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:10:10.485610+0000","last_undegraded":"2024-09-22T03:10:10.485610+0000","last_fullsized":"2024-09-22T03:10:10.485610+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111820,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94260020,"statfs":{"total":96636764160,"available":96522260480,"internally_reserved":0,"allocated":323584,"data_stored":107516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81352,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94290488,"statfs":{"total":96636764160,"available":96553459712,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99400,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272440,"statfs":{"total":96636764160,"available":96534978560,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93828,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94278012,"statfs":{"total":96636764160,"available":96540684288,"internally_reserved":0,"allocated":380928,"data_stored":697865,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:12.132 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:12.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:12.231+0000 7efccc2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:12.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:12.238+0000 7efccc2d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:12.418 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:10:12.418 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:10:12.434 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-22T03:10:11.382749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":386400,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":384896,"kb_avail":377100960,"statfs":{"total":386547056640,"available":386151383040,"internally_reserved":0,"allocated":1474560,"data_stored":2201149,"data_compressed":89886,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":394133504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000731"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.483477+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:10:10.483477+0000","last_peered":"2024-09-22T03:10:10.483477+0000","last_clean":"2024-09-22T03:10:10.483477+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:10:10.483477+0000","last_undegraded":"2024-09-22T03:10:10.483477+0000","last_fullsized":"2024-09-22T03:10:10.483477+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.483305+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:10:10.483305+0000","last_peered":"2024-09-22T03:10:10.483305+0000","last_clean":"2024-09-22T03:10:10.483305+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:10:10.483305+0000","last_undegraded":"2024-09-22T03:10:10.483305+0000","last_fullsized":"2024-09-22T03:10:10.483305+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":90,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.482471+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:10:10.482471+0000","last_peered":"2024-09-22T03:10:10.482471+0000","last_clean":"2024-09-22T03:10:10.482471+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:10:10.482471+0000","last_undegraded":"2024-09-22T03:10:10.482471+0000","last_fullsized":"2024-09-22T03:10:10.482471+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":89,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485016+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:10:10.485016+0000","last_peered":"2024-09-22T03:10:10.485016+0000","last_clean":"2024-09-22T03:10:10.485016+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:10:10.485016+0000","last_undegraded":"2024-09-22T03:10:10.485016+0000","last_fullsized":"2024-09-22T03:10:10.485016+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":214,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.484836+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:10:10.484836+0000","last_peered":"2024-09-22T03:10:10.484836+0000","last_clean":"2024-09-22T03:10:10.484836+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:10:10.484836+0000","last_undegraded":"2024-09-22T03:10:10.484836+0000","last_fullsized":"2024-09-22T03:10:10.484836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.484328+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:10:10.484328+0000","last_peered":"2024-09-22T03:10:10.484328+0000","last_clean":"2024-09-22T03:10:10.484328+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:10:10.484328+0000","last_undegraded":"2024-09-22T03:10:10.484328+0000","last_fullsized":"2024-09-22T03:10:10.484328+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485177+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:10:10.485177+0000","last_peered":"2024-09-22T03:10:10.485177+0000","last_clean":"2024-09-22T03:10:10.485177+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:10:10.485177+0000","last_undegraded":"2024-09-22T03:10:10.485177+0000","last_fullsized":"2024-09-22T03:10:10.485177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485777+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:10:10.485777+0000","last_peered":"2024-09-22T03:10:10.485777+0000","last_clean":"2024-09-22T03:10:10.485777+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:10:10.485777+0000","last_undegraded":"2024-09-22T03:10:10.485777+0000","last_fullsized":"2024-09-22T03:10:10.485777+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485610+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:10:10.485610+0000","last_peered":"2024-09-22T03:10:10.485610+0000","last_clean":"2024-09-22T03:10:10.485610+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:10:10.485610+0000","last_undegraded":"2024-09-22T03:10:10.485610+0000","last_fullsized":"2024-09-22T03:10:10.485610+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111820,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94260020,"statfs":{"total":96636764160,"available":96522260480,"internally_reserved":0,"allocated":323584,"data_stored":107516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81352,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94290488,"statfs":{"total":96636764160,"available":96553459712,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99400,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272440,"statfs":{"total":96636764160,"available":96534978560,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93828,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94278012,"statfs":{"total":96636764160,"available":96540684288,"internally_reserved":0,"allocated":380928,"data_stored":697865,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:12.435 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-22T03:10:12.435 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-22T03:10:12.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:12.544+0000 7f7c69463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:12.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:12.553+0000 7f7c69463640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:12.747 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-22T03:10:12.770 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-22T03:10:12.770 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:12.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:12.871+0000 7f5c786d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:12.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:12.877+0000 7f5c786d7640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:13.051 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:10:13.051 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:10:13.063 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-22T03:10:11.382749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":386400,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":384896,"kb_avail":377100960,"statfs":{"total":386547056640,"available":386151383040,"internally_reserved":0,"allocated":1474560,"data_stored":2201149,"data_compressed":89886,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":394133504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000731"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.483477+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:10:10.483477+0000","last_peered":"2024-09-22T03:10:10.483477+0000","last_clean":"2024-09-22T03:10:10.483477+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:10:10.483477+0000","last_undegraded":"2024-09-22T03:10:10.483477+0000","last_fullsized":"2024-09-22T03:10:10.483477+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.483305+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:10:10.483305+0000","last_peered":"2024-09-22T03:10:10.483305+0000","last_clean":"2024-09-22T03:10:10.483305+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:10:10.483305+0000","last_undegraded":"2024-09-22T03:10:10.483305+0000","last_fullsized":"2024-09-22T03:10:10.483305+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":90,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.482471+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:10:10.482471+0000","last_peered":"2024-09-22T03:10:10.482471+0000","last_clean":"2024-09-22T03:10:10.482471+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:10:10.482471+0000","last_undegraded":"2024-09-22T03:10:10.482471+0000","last_fullsized":"2024-09-22T03:10:10.482471+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":89,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485016+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:10:10.485016+0000","last_peered":"2024-09-22T03:10:10.485016+0000","last_clean":"2024-09-22T03:10:10.485016+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:10:10.485016+0000","last_undegraded":"2024-09-22T03:10:10.485016+0000","last_fullsized":"2024-09-22T03:10:10.485016+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":214,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.484836+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:10:10.484836+0000","last_peered":"2024-09-22T03:10:10.484836+0000","last_clean":"2024-09-22T03:10:10.484836+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:10:10.484836+0000","last_undegraded":"2024-09-22T03:10:10.484836+0000","last_fullsized":"2024-09-22T03:10:10.484836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.484328+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:10:10.484328+0000","last_peered":"2024-09-22T03:10:10.484328+0000","last_clean":"2024-09-22T03:10:10.484328+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:10:10.484328+0000","last_undegraded":"2024-09-22T03:10:10.484328+0000","last_fullsized":"2024-09-22T03:10:10.484328+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485177+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:10:10.485177+0000","last_peered":"2024-09-22T03:10:10.485177+0000","last_clean":"2024-09-22T03:10:10.485177+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:10:10.485177+0000","last_undegraded":"2024-09-22T03:10:10.485177+0000","last_fullsized":"2024-09-22T03:10:10.485177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485777+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:10:10.485777+0000","last_peered":"2024-09-22T03:10:10.485777+0000","last_clean":"2024-09-22T03:10:10.485777+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:10:10.485777+0000","last_undegraded":"2024-09-22T03:10:10.485777+0000","last_fullsized":"2024-09-22T03:10:10.485777+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485610+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:10:10.485610+0000","last_peered":"2024-09-22T03:10:10.485610+0000","last_clean":"2024-09-22T03:10:10.485610+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:10:10.485610+0000","last_undegraded":"2024-09-22T03:10:10.485610+0000","last_fullsized":"2024-09-22T03:10:10.485610+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111820,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94260020,"statfs":{"total":96636764160,"available":96522260480,"internally_reserved":0,"allocated":323584,"data_stored":107516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81352,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94290488,"statfs":{"total":96636764160,"available":96553459712,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99400,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272440,"statfs":{"total":96636764160,"available":96534978560,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93828,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94278012,"statfs":{"total":96636764160,"available":96540684288,"internally_reserved":0,"allocated":380928,"data_stored":697865,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:13.064 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:13.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:13.162+0000 7f9f9bcba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:13.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:13.168+0000 7f9f9bcba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:13.345 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:10:13.346 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:10:13.358 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":244,"stamp":"2024-09-22T03:10:11.382749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":386400,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":384896,"kb_avail":377100960,"statfs":{"total":386547056640,"available":386151383040,"internally_reserved":0,"allocated":1474560,"data_stored":2201149,"data_compressed":89886,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":394133504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000731"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.483477+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:10:10.483477+0000","last_peered":"2024-09-22T03:10:10.483477+0000","last_clean":"2024-09-22T03:10:10.483477+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:10:10.483477+0000","last_undegraded":"2024-09-22T03:10:10.483477+0000","last_fullsized":"2024-09-22T03:10:10.483477+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.483305+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:10:10.483305+0000","last_peered":"2024-09-22T03:10:10.483305+0000","last_clean":"2024-09-22T03:10:10.483305+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:10:10.483305+0000","last_undegraded":"2024-09-22T03:10:10.483305+0000","last_fullsized":"2024-09-22T03:10:10.483305+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":90,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.482471+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:10:10.482471+0000","last_peered":"2024-09-22T03:10:10.482471+0000","last_clean":"2024-09-22T03:10:10.482471+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:10:10.482471+0000","last_undegraded":"2024-09-22T03:10:10.482471+0000","last_fullsized":"2024-09-22T03:10:10.482471+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":89,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485016+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:10:10.485016+0000","last_peered":"2024-09-22T03:10:10.485016+0000","last_clean":"2024-09-22T03:10:10.485016+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:10:10.485016+0000","last_undegraded":"2024-09-22T03:10:10.485016+0000","last_fullsized":"2024-09-22T03:10:10.485016+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":214,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.484836+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:10:10.484836+0000","last_peered":"2024-09-22T03:10:10.484836+0000","last_clean":"2024-09-22T03:10:10.484836+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:10:10.484836+0000","last_undegraded":"2024-09-22T03:10:10.484836+0000","last_fullsized":"2024-09-22T03:10:10.484836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.484328+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:10:10.484328+0000","last_peered":"2024-09-22T03:10:10.484328+0000","last_clean":"2024-09-22T03:10:10.484328+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:10:10.484328+0000","last_undegraded":"2024-09-22T03:10:10.484328+0000","last_fullsized":"2024-09-22T03:10:10.484328+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485177+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:10:10.485177+0000","last_peered":"2024-09-22T03:10:10.485177+0000","last_clean":"2024-09-22T03:10:10.485177+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:10:10.485177+0000","last_undegraded":"2024-09-22T03:10:10.485177+0000","last_fullsized":"2024-09-22T03:10:10.485177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485777+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:10:10.485777+0000","last_peered":"2024-09-22T03:10:10.485777+0000","last_clean":"2024-09-22T03:10:10.485777+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:10:10.485777+0000","last_undegraded":"2024-09-22T03:10:10.485777+0000","last_fullsized":"2024-09-22T03:10:10.485777+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485610+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:10:10.485610+0000","last_peered":"2024-09-22T03:10:10.485610+0000","last_clean":"2024-09-22T03:10:10.485610+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:10:10.485610+0000","last_undegraded":"2024-09-22T03:10:10.485610+0000","last_fullsized":"2024-09-22T03:10:10.485610+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111820,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94260020,"statfs":{"total":96636764160,"available":96522260480,"internally_reserved":0,"allocated":323584,"data_stored":107516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81352,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94290488,"statfs":{"total":96636764160,"available":96553459712,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99400,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272440,"statfs":{"total":96636764160,"available":96534978560,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93828,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94278012,"statfs":{"total":96636764160,"available":96540684288,"internally_reserved":0,"allocated":380928,"data_stored":697865,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:13.358 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-22T03:10:13.359 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:13.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:13.458+0000 7efe6cd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:13.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:13.464+0000 7efe6cd57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:13.640 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:10:13.641 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:10:13.653 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-09-22T03:10:13.383286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":386400,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":384896,"kb_avail":377100960,"statfs":{"total":386547056640,"available":386151383040,"internally_reserved":0,"allocated":1474560,"data_stored":2201149,"data_compressed":89886,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":394133504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.920859"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.483477+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:10:10.483477+0000","last_peered":"2024-09-22T03:10:10.483477+0000","last_clean":"2024-09-22T03:10:10.483477+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:10:10.483477+0000","last_undegraded":"2024-09-22T03:10:10.483477+0000","last_fullsized":"2024-09-22T03:10:10.483477+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.483305+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:10:10.483305+0000","last_peered":"2024-09-22T03:10:10.483305+0000","last_clean":"2024-09-22T03:10:10.483305+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:10:10.483305+0000","last_undegraded":"2024-09-22T03:10:10.483305+0000","last_fullsized":"2024-09-22T03:10:10.483305+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":90,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.482471+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:10:10.482471+0000","last_peered":"2024-09-22T03:10:10.482471+0000","last_clean":"2024-09-22T03:10:10.482471+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:10:10.482471+0000","last_undegraded":"2024-09-22T03:10:10.482471+0000","last_fullsized":"2024-09-22T03:10:10.482471+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":89,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485016+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:10:10.485016+0000","last_peered":"2024-09-22T03:10:10.485016+0000","last_clean":"2024-09-22T03:10:10.485016+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:10:10.485016+0000","last_undegraded":"2024-09-22T03:10:10.485016+0000","last_fullsized":"2024-09-22T03:10:10.485016+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":214,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.484836+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:10:10.484836+0000","last_peered":"2024-09-22T03:10:10.484836+0000","last_clean":"2024-09-22T03:10:10.484836+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:10:10.484836+0000","last_undegraded":"2024-09-22T03:10:10.484836+0000","last_fullsized":"2024-09-22T03:10:10.484836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.484328+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:10:10.484328+0000","last_peered":"2024-09-22T03:10:10.484328+0000","last_clean":"2024-09-22T03:10:10.484328+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:10:10.484328+0000","last_undegraded":"2024-09-22T03:10:10.484328+0000","last_fullsized":"2024-09-22T03:10:10.484328+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485177+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:10:10.485177+0000","last_peered":"2024-09-22T03:10:10.485177+0000","last_clean":"2024-09-22T03:10:10.485177+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:10:10.485177+0000","last_undegraded":"2024-09-22T03:10:10.485177+0000","last_fullsized":"2024-09-22T03:10:10.485177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485777+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:10:10.485777+0000","last_peered":"2024-09-22T03:10:10.485777+0000","last_clean":"2024-09-22T03:10:10.485777+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:10:10.485777+0000","last_undegraded":"2024-09-22T03:10:10.485777+0000","last_fullsized":"2024-09-22T03:10:10.485777+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485610+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:10:10.485610+0000","last_peered":"2024-09-22T03:10:10.485610+0000","last_clean":"2024-09-22T03:10:10.485610+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:10:10.485610+0000","last_undegraded":"2024-09-22T03:10:10.485610+0000","last_fullsized":"2024-09-22T03:10:10.485610+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111820,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94260020,"statfs":{"total":96636764160,"available":96522260480,"internally_reserved":0,"allocated":323584,"data_stored":107516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81352,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94290488,"statfs":{"total":96636764160,"available":96553459712,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99400,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272440,"statfs":{"total":96636764160,"available":96534978560,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706090,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93828,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94278012,"statfs":{"total":96636764160,"available":96540684288,"internally_reserved":0,"allocated":380928,"data_stored":697865,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:13.654 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-22T03:10:13.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:13.754+0000 7fa0a70ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:13.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:13.760+0000 7fa0a70ba640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:13.942 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:10:13.942 INFO:teuthology.orchestra.run.smithi145.stdout:{"epoch":38,"fsid":"110716e9-1590-4d11-aa79-697b4ec9a4b0","created":"2024-09-22T03:02:57.063974+0000","modified":"2024-09-22T03:10:10.475328+0000","last_up_change":"2024-09-22T03:03:05.317100+0000","last_in_change":"2024-09-22T03:02:59.144490+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-09-22T03:03:07.249906+0000","flags":270369,"flags_names":"hashpspool,nopgchange,selfmanaged_snaps,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":14,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-09-22T03:03:07.334071+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3d85fcc9-e5d4-4463-8465-afb150e1d595","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":2286030306}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6801","nonce":2286030306}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6805","nonce":2286030306}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":2286030306}]},"public_addr":"172.21.15.145:6802/2286030306","cluster_addr":"172.21.15.145:6801/2286030306","heartbeat_back_addr":"172.21.15.145:6805/2286030306","heartbeat_front_addr":"172.21.15.145:6806/2286030306","state":["exists","up"]},{"osd":1,"uuid":"89ec4223-137c-4451-b184-e334dd762925","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":3284590914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6803","nonce":3284590914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":3284590914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6813","nonce":3284590914}]},"public_addr":"172.21.15.145:6804/3284590914","cluster_addr":"172.21.15.145:6803/3284590914","heartbeat_back_addr":"172.21.15.145:6814/3284590914","heartbeat_front_addr":"172.21.15.145:6813/3284590914","state":["exists","up"]},{"osd":2,"uuid":"d0346c80-1ff5-42a1-a9fe-82ff81bbd91e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":792102490}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6805","nonce":792102490}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":792102490}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6807","nonce":792102490}]},"public_addr":"172.21.15.194:6804/792102490","cluster_addr":"172.21.15.194:6805/792102490","heartbeat_back_addr":"172.21.15.194:6808/792102490","heartbeat_front_addr":"172.21.15.194:6807/792102490","state":["exists","up"]},{"osd":3,"uuid":"974b2daf-1154-410d-a87f-c085313352a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6803","nonce":2433098210}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2433098210}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6811","nonce":2433098210}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":2433098210}]},"public_addr":"172.21.15.194:6803/2433098210","cluster_addr":"172.21.15.194:6802/2433098210","heartbeat_back_addr":"172.21.15.194:6811/2433098210","heartbeat_front_addr":"172.21.15.194:6810/2433098210","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":1,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-22T03:10:14.955 INFO:tasks.ceph:Scrubbing osd.0 2024-09-22T03:10:14.955 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-22T03:10:15.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:15.068+0000 7fb825f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:15.079+0000 7fb825f97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.093 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-22T03:10:15.093 INFO:teuthology.orchestra.run.smithi145.stdout: "success": "" 2024-09-22T03:10:15.093 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-22T03:10:15.104 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-22T03:10:15.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:15.204+0000 7fbf448c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:15.211+0000 7fbf448c3640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:instructed osd(s) 0 to deep-scrub 2024-09-22T03:10:15.407 INFO:tasks.ceph:Scrubbing osd.1 2024-09-22T03:10:15.407 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-22T03:10:15.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:15.510+0000 7fc135597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:15.522+0000 7fc135597640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.538 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-22T03:10:15.539 INFO:teuthology.orchestra.run.smithi145.stdout: "success": "" 2024-09-22T03:10:15.539 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-22T03:10:15.547 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-22T03:10:15.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:15.645+0000 7f6b33f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:15.653+0000 7f6b33f57640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.836 INFO:teuthology.orchestra.run.smithi145.stderr:instructed osd(s) 1 to deep-scrub 2024-09-22T03:10:15.852 INFO:tasks.ceph:Scrubbing osd.2 2024-09-22T03:10:15.853 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-22T03:10:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:15.953+0000 7f36c766c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:15.963+0000 7f36c766c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:15.978 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-22T03:10:15.978 INFO:teuthology.orchestra.run.smithi145.stdout: "success": "" 2024-09-22T03:10:15.978 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-22T03:10:15.989 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-22T03:10:16.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:16.086+0000 7fc55e50e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:16.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:16.094+0000 7fc55e50e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:instructed osd(s) 2 to deep-scrub 2024-09-22T03:10:16.288 INFO:tasks.ceph:Scrubbing osd.3 2024-09-22T03:10:16.288 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-22T03:10:16.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:16.385+0000 7f134cd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:16.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:16.396+0000 7f134cd97640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:16.411 INFO:teuthology.orchestra.run.smithi145.stdout:{ 2024-09-22T03:10:16.411 INFO:teuthology.orchestra.run.smithi145.stdout: "success": "" 2024-09-22T03:10:16.411 INFO:teuthology.orchestra.run.smithi145.stdout:} 2024-09-22T03:10:16.422 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-22T03:10:16.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:16.521+0000 7f4a54a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:16.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:16.529+0000 7f4a54a2c640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:16.706 INFO:teuthology.orchestra.run.smithi145.stderr:instructed osd(s) 3 to deep-scrub 2024-09-22T03:10:16.721 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:16.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:16.820+0000 7fe426957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:16.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:16.826+0000 7fe426957640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:17.003 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:10:17.004 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:10:17.015 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2024-09-22T03:10:15.383666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":386400,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":384896,"kb_avail":377100960,"statfs":{"total":386547056640,"available":386151383040,"internally_reserved":0,"allocated":1474560,"data_stored":2201149,"data_compressed":89886,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":394133504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.915998"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.483477+0000","last_change":"2024-09-22T03:03:10.361408+0000","last_active":"2024-09-22T03:10:10.483477+0000","last_peered":"2024-09-22T03:10:10.483477+0000","last_clean":"2024-09-22T03:10:10.483477+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:10:10.483477+0000","last_undegraded":"2024-09-22T03:10:10.483477+0000","last_fullsized":"2024-09-22T03:10:10.483477+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.483305+0000","last_change":"2024-09-22T03:03:10.361802+0000","last_active":"2024-09-22T03:10:10.483305+0000","last_peered":"2024-09-22T03:10:10.483305+0000","last_clean":"2024-09-22T03:10:10.483305+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:10:10.483305+0000","last_undegraded":"2024-09-22T03:10:10.483305+0000","last_fullsized":"2024-09-22T03:10:10.483305+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":90,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.482471+0000","last_change":"2024-09-22T03:03:10.362354+0000","last_active":"2024-09-22T03:10:10.482471+0000","last_peered":"2024-09-22T03:10:10.482471+0000","last_clean":"2024-09-22T03:10:10.482471+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:10:10.482471+0000","last_undegraded":"2024-09-22T03:10:10.482471+0000","last_fullsized":"2024-09-22T03:10:10.482471+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":89,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485016+0000","last_change":"2024-09-22T03:03:10.364195+0000","last_active":"2024-09-22T03:10:10.485016+0000","last_peered":"2024-09-22T03:10:10.485016+0000","last_clean":"2024-09-22T03:10:10.485016+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:10:10.485016+0000","last_undegraded":"2024-09-22T03:10:10.485016+0000","last_fullsized":"2024-09-22T03:10:10.485016+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":214,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.484836+0000","last_change":"2024-09-22T03:03:08.396417+0000","last_active":"2024-09-22T03:10:10.484836+0000","last_peered":"2024-09-22T03:10:10.484836+0000","last_clean":"2024-09-22T03:10:10.484836+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:10:10.484836+0000","last_undegraded":"2024-09-22T03:10:10.484836+0000","last_fullsized":"2024-09-22T03:10:10.484836+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.484328+0000","last_change":"2024-09-22T03:03:10.360944+0000","last_active":"2024-09-22T03:10:10.484328+0000","last_peered":"2024-09-22T03:10:10.484328+0000","last_clean":"2024-09-22T03:10:10.484328+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:10:10.484328+0000","last_undegraded":"2024-09-22T03:10:10.484328+0000","last_fullsized":"2024-09-22T03:10:10.484328+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485177+0000","last_change":"2024-09-22T03:03:10.363935+0000","last_active":"2024-09-22T03:10:10.485177+0000","last_peered":"2024-09-22T03:10:10.485177+0000","last_clean":"2024-09-22T03:10:10.485177+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:10:10.485177+0000","last_undegraded":"2024-09-22T03:10:10.485177+0000","last_fullsized":"2024-09-22T03:10:10.485177+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485777+0000","last_change":"2024-09-22T03:03:10.363626+0000","last_active":"2024-09-22T03:10:10.485777+0000","last_peered":"2024-09-22T03:10:10.485777+0000","last_clean":"2024-09-22T03:10:10.485777+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:10:10.485777+0000","last_undegraded":"2024-09-22T03:10:10.485777+0000","last_fullsized":"2024-09-22T03:10:10.485777+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":88,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:10.485610+0000","last_change":"2024-09-22T03:03:10.363477+0000","last_active":"2024-09-22T03:10:10.485610+0000","last_peered":"2024-09-22T03:10:10.485610+0000","last_clean":"2024-09-22T03:10:10.485610+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:10:10.485610+0000","last_undegraded":"2024-09-22T03:10:10.485610+0000","last_fullsized":"2024-09-22T03:10:10.485610+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:03:07.334462+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111820,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94260020,"statfs":{"total":96636764160,"available":96522260480,"internally_reserved":0,"allocated":323584,"data_stored":107516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81352,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94290488,"statfs":{"total":96636764160,"available":96553459712,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673385,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99400,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272440,"statfs":{"total":96636764160,"available":96534978560,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706093,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93828,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94278012,"statfs":{"total":96636764160,"available":96540684288,"internally_reserved":0,"allocated":380928,"data_stored":697865,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:17.018 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-22T03:03:07.334462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=3, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=10, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:10:17.018 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-09-22T03:03:07.334462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=3, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=10, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:10:17.018 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-09-22T03:03:07.334462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=3, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=10, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:10:17.019 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-09-22T03:03:07.334462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=3, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=10, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:10:17.019 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-22T03:03:07.334462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=3, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=10, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:10:17.019 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-09-22T03:03:07.334462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=3, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=10, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:10:17.019 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-09-22T03:03:07.334462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=3, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=10, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:10:17.019 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-09-22T03:03:07.334462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=3, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=10, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:10:17.019 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-09-22T03:03:07.334462+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=3, tm_sec=7, tm_wday=6, tm_yday=266, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=22, tm_hour=3, tm_min=10, tm_sec=13, tm_wday=6, tm_yday=266, tm_isdst=0) 2024-09-22T03:10:17.019 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-22T03:10:37.020 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-22T03:10:37.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:37.135+0000 7f7f1f458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:37.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:37.142+0000 7f7f1f458640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:37.319 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-22T03:10:37.319 INFO:teuthology.orchestra.run.smithi145.stderr:dumped all 2024-09-22T03:10:37.331 INFO:teuthology.orchestra.run.smithi145.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2024-09-22T03:10:35.387955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":139,"num_write_kb":1896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":386400,"kb_used_data":1440,"kb_used_omap":0,"kb_used_meta":384896,"kb_avail":377100960,"statfs":{"total":386547056640,"available":386151383040,"internally_reserved":0,"allocated":1474560,"data_stored":2201149,"data_compressed":89886,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":394133504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002770"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":90,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.706567+0000","last_change":"2024-09-22T03:10:16.713848+0000","last_active":"2024-09-22T03:10:16.706567+0000","last_peered":"2024-09-22T03:10:16.706567+0000","last_clean":"2024-09-22T03:10:16.706567+0000","last_became_active":"2024-09-22T03:03:08.383040+0000","last_became_peered":"2024-09-22T03:03:08.383040+0000","last_unstale":"2024-09-22T03:10:16.706567+0000","last_undegraded":"2024-09-22T03:10:16.706567+0000","last_fullsized":"2024-09-22T03:10:16.706567+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:10:16.713669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:10:16.713669+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":90,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:15.390237+0000","last_change":"2024-09-22T03:10:15.405711+0000","last_active":"2024-09-22T03:10:15.390237+0000","last_peered":"2024-09-22T03:10:15.390237+0000","last_clean":"2024-09-22T03:10:15.390237+0000","last_became_active":"2024-09-22T03:03:08.380570+0000","last_became_peered":"2024-09-22T03:03:08.380570+0000","last_unstale":"2024-09-22T03:10:15.390237+0000","last_undegraded":"2024-09-22T03:10:15.390237+0000","last_fullsized":"2024-09-22T03:10:15.390237+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:10:15.405601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:10:15.405601+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"14'2","reported_seq":92,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.273973+0000","last_change":"2024-09-22T03:10:16.281192+0000","last_active":"2024-09-22T03:10:16.273973+0000","last_peered":"2024-09-22T03:10:16.273973+0000","last_clean":"2024-09-22T03:10:16.273973+0000","last_became_active":"2024-09-22T03:03:08.385996+0000","last_became_peered":"2024-09-22T03:03:08.385996+0000","last_unstale":"2024-09-22T03:10:16.273973+0000","last_undegraded":"2024-09-22T03:10:16.273973+0000","last_fullsized":"2024-09-22T03:10:16.273973+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"14'2","last_scrub_stamp":"2024-09-22T03:10:16.281070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:10:16.281070+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"12'1","reported_seq":91,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.707387+0000","last_change":"2024-09-22T03:10:16.853916+0000","last_active":"2024-09-22T03:10:16.707387+0000","last_peered":"2024-09-22T03:10:16.707387+0000","last_clean":"2024-09-22T03:10:16.707387+0000","last_became_active":"2024-09-22T03:03:08.391733+0000","last_became_peered":"2024-09-22T03:03:08.391733+0000","last_unstale":"2024-09-22T03:10:16.707387+0000","last_undegraded":"2024-09-22T03:10:16.707387+0000","last_fullsized":"2024-09-22T03:10:16.707387+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'1","last_scrub_stamp":"2024-09-22T03:10:16.853796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:10:16.853796+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"12'97","reported_seq":216,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:15.390966+0000","last_change":"2024-09-22T03:10:15.529563+0000","last_active":"2024-09-22T03:10:15.390966+0000","last_peered":"2024-09-22T03:10:15.390966+0000","last_clean":"2024-09-22T03:10:15.390966+0000","last_became_active":"2024-09-22T03:03:08.389570+0000","last_became_peered":"2024-09-22T03:03:08.389570+0000","last_unstale":"2024-09-22T03:10:15.390966+0000","last_undegraded":"2024-09-22T03:10:15.390966+0000","last_fullsized":"2024-09-22T03:10:15.390966+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'97","last_scrub_stamp":"2024-09-22T03:10:15.529284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:10:15.529284+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":90,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:15.836352+0000","last_change":"2024-09-22T03:10:15.844355+0000","last_active":"2024-09-22T03:10:15.836352+0000","last_peered":"2024-09-22T03:10:15.836352+0000","last_clean":"2024-09-22T03:10:15.836352+0000","last_became_active":"2024-09-22T03:03:08.397663+0000","last_became_peered":"2024-09-22T03:03:08.397663+0000","last_unstale":"2024-09-22T03:10:15.836352+0000","last_undegraded":"2024-09-22T03:10:15.836352+0000","last_fullsized":"2024-09-22T03:10:15.836352+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:10:15.844182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:10:15.844182+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":90,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:16.274729+0000","last_change":"2024-09-22T03:10:16.279892+0000","last_active":"2024-09-22T03:10:16.274729+0000","last_peered":"2024-09-22T03:10:16.274729+0000","last_clean":"2024-09-22T03:10:16.274729+0000","last_became_active":"2024-09-22T03:03:08.401582+0000","last_became_peered":"2024-09-22T03:03:08.401582+0000","last_unstale":"2024-09-22T03:10:16.274729+0000","last_undegraded":"2024-09-22T03:10:16.274729+0000","last_fullsized":"2024-09-22T03:10:16.274729+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:10:16.279792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:10:16.279792+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":90,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:15.837026+0000","last_change":"2024-09-22T03:10:15.845875+0000","last_active":"2024-09-22T03:10:15.837026+0000","last_peered":"2024-09-22T03:10:15.837026+0000","last_clean":"2024-09-22T03:10:15.837026+0000","last_became_active":"2024-09-22T03:03:08.396459+0000","last_became_peered":"2024-09-22T03:03:08.396459+0000","last_unstale":"2024-09-22T03:10:15.837026+0000","last_undegraded":"2024-09-22T03:10:15.837026+0000","last_fullsized":"2024-09-22T03:10:15.837026+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:10:15.845775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:10:15.845775+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":90,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-22T03:10:15.837252+0000","last_change":"2024-09-22T03:10:15.916422+0000","last_active":"2024-09-22T03:10:15.837252+0000","last_peered":"2024-09-22T03:10:15.837252+0000","last_clean":"2024-09-22T03:10:15.837252+0000","last_became_active":"2024-09-22T03:03:08.383941+0000","last_became_peered":"2024-09-22T03:03:08.383941+0000","last_unstale":"2024-09-22T03:10:15.837252+0000","last_undegraded":"2024-09-22T03:10:15.837252+0000","last_fullsized":"2024-09-22T03:10:15.837252+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-22T03:10:15.916333+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-22T03:10:15.916333+0000","last_clean_scrub_stamp":"2024-09-22T03:03:07.334462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":1},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":24,"acting":24,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673405,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":111820,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":111488,"kb_avail":94260020,"statfs":{"total":96636764160,"available":96522260480,"internally_reserved":0,"allocated":323584,"data_stored":107516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":114163712},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673405,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":81352,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":80960,"kb_avail":94290488,"statfs":{"total":96636764160,"available":96553459712,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":82903040},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673405,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":99400,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":99008,"kb_avail":94272440,"statfs":{"total":96636764160,"available":96534978560,"internally_reserved":0,"allocated":385024,"data_stored":697884,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":101384192},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":93828,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":93440,"kb_avail":94278012,"statfs":{"total":96636764160,"available":96540684288,"internally_reserved":0,"allocated":380928,"data_stored":697865,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":95682560},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":590368,"data_compressed":29962,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-22T03:10:37.333 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-22T03:10:37.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:37.428+0000 7f98c030e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:37.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-22T03:10:37.438+0000 7f98c030e640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-09-22T03:10:37.630 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-22T03:10:37.630 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-22T03:10:37.630 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-22T03:10:37.630 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T03:10:39.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-22T03:10:43.732 INFO:tasks.ceph.osd.0:Stopped 2024-09-22T03:10:43.732 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-22T03:10:43.733 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T03:10:44.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-22T03:10:44.662 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-22T03:10:49.834 INFO:tasks.ceph.osd.1:Stopped 2024-09-22T03:10:49.835 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-22T03:10:49.835 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T03:10:50.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~5s 2024-09-22T03:10:55.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-22T03:10:55.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-22T03:10:55.936 INFO:tasks.ceph.osd.2:Stopped 2024-09-22T03:10:55.937 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-22T03:10:55.937 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T03:11:00.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-22T03:11:00.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-22T03:11:02.038 INFO:tasks.ceph.osd.3:Stopped 2024-09-22T03:11:02.038 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-22T03:11:02.039 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-22T03:11:02.039 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T03:11:02.072 INFO:tasks.ceph.mgr.x:Stopped 2024-09-22T03:11:02.072 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-22T03:11:02.072 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-22T03:11:02.073 INFO:teuthology.orchestra.run:waiting for 300 2024-09-22T03:11:02.086 INFO:tasks.ceph.mon.a:Stopped 2024-09-22T03:11:02.087 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-22T03:11:02.087 DEBUG:teuthology.orchestra.run.smithi145:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-22T03:11:02.247 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-22T03:11:02.248 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-22T03:11:02.340 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-22T03:11:02.340 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-22T03:11:02.438 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-22T03:11:02.438 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-22T03:11:02.690 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-22T03:11:02.690 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-22T03:11:02.772 INFO:tasks.ceph:Archiving mon data... 2024-09-22T03:11:02.773 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914713/data/mon.a.tgz 2024-09-22T03:11:02.773 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-09-22T03:11:02.792 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.5MaRrXeo4P 2024-09-22T03:11:02.793 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.5MaRrXeo4P 2024-09-22T03:11:02.932 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.5MaRrXeo4P 2024-09-22T03:11:03.018 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.5MaRrXeo4P is 282KB 2024-09-22T03:11:03.112 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.5MaRrXeo4P 2024-09-22T03:11:03.127 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-22T03:11:03.127 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T03:11:03.169 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-22T03:11:03.246 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T03:11:03.261 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-22T03:11:03.262 INFO:tasks.ceph:Archiving crash dumps... 2024-09-22T03:11:03.263 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914713/remote/smithi145/crash 2024-09-22T03:11:03.264 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T03:11:03.311 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914713/remote/smithi194/crash 2024-09-22T03:11:03.312 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-22T03:11:03.346 INFO:tasks.ceph:Compressing logs... 2024-09-22T03:11:03.346 DEBUG:teuthology.orchestra.run.smithi145:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T03:11:03.356 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-22T03:11:03.377 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-22T03:11:03.377 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40469.log 2024-09-22T03:11:03.416 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27657.log 2024-09-22T03:11:03.416 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27748.log 2024-09-22T03:11:03.416 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27788.log 2024-09-22T03:11:03.417 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.27657.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27657.log.gz 2024-09-22T03:11:03.417 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.27748.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-22T03:11:03.417 INFO:teuthology.orchestra.run.smithi194.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27748.log.gz 2024-09-22T03:11:03.417 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-22T03:11:03.417 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.27788.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27788.log.gz 2024-09-22T03:11:03.417 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-22T03:11:03.417 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27708.log 2024-09-22T03:11:03.417 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.27708.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.27708.log.gz 2024-09-22T03:11:03.482 INFO:teuthology.orchestra.run.smithi194.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-22T03:11:03.505 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39316.log 2024-09-22T03:11:03.505 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.40469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46699.log 2024-09-22T03:11:03.505 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40469.log.gz 2024-09-22T03:11:03.505 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42911.log 2024-09-22T03:11:03.505 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39316.log.gz 2024-09-22T03:11:03.505 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32978.log 2024-09-22T03:11:03.506 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46699.log.gz 2024-09-22T03:11:03.506 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44244.log 2024-09-22T03:11:03.506 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42911.log.gz 2024-09-22T03:11:03.506 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46144.log 2024-09-22T03:11:03.506 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32978.log.gz 2024-09-22T03:11:03.506 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44106.log 2024-09-22T03:11:03.506 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44244.log.gz 2024-09-22T03:11:03.506 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44811.log 2024-09-22T03:11:03.506 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46144.log.gz 2024-09-22T03:11:03.506 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45447.log 2024-09-22T03:11:03.506 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44106.log.gz 2024-09-22T03:11:03.506 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37766.log 2024-09-22T03:11:03.506 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44811.log.gz 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45398.log 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45447.log.gz 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29170.log 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37766.log.gz 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33048.log 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45398.log.gz 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39506.log 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29170.log.gz 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29313.log 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33048.log.gz 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46581.log 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39506.log.gz 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34852.log 2024-09-22T03:11:03.507 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29313.log.gz 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44064.log 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46581.log.gz 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30465.log 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34852.log.gz 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35388.log 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44064.log.gz 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33538.log 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30465.log.gz 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35955.log 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35388.log.gz 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33249.log 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33538.log.gz 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30085.log 2024-09-22T03:11:03.508 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35955.log.gz 2024-09-22T03:11:03.509 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45029.log 2024-09-22T03:11:03.509 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33249.log.gz 2024-09-22T03:11:03.509 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29716.log 2024-09-22T03:11:03.509 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30085.log.gz 2024-09-22T03:11:03.509 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35913.log 2024-09-22T03:11:03.509 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45029.log.gz 2024-09-22T03:11:03.509 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43169.log 2024-09-22T03:11:03.509 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29716.log.gz 2024-09-22T03:11:03.509 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40560.log 2024-09-22T03:11:03.509 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35913.log.gz 2024-09-22T03:11:03.509 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40053.log 2024-09-22T03:11:03.509 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43169.log.gz 2024-09-22T03:11:03.509 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36451.log 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40560.log.gz 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41085.log 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40053.log.gz 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36242.log 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36451.log.gz 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46186.log 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41085.log.gz 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45118.log 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36242.log.gz 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29926.log 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46186.log.gz 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34572.log 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45118.log.gz 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29674.log 2024-09-22T03:11:03.510 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29926.log.gz 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39058.log 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34572.log.gz 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41223.log 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29674.log.gz 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44562.log 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39058.log.gz 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33250.log 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41223.log.gz 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40420.log 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44562.log.gz 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42086.log 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33250.log.gz 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39953.log 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40420.log.gz 2024-09-22T03:11:03.511 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35815.log 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42086.log.gz 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43847.log 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39953.log.gz 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30565.log 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35815.log.gz 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46060.log 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43847.log.gz 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34432.log 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30565.log.gz 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41561.log 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46060.log.gz 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40609.log 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34432.log.gz 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33097.log 2024-09-22T03:11:03.512 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41561.log.gz 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46018.log 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40609.log.gz 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41044.log 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.33097.log.gz 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46018.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46018.log.gz 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32561.log 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41044.log.gz 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31853.log 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32839.log 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32561.log.gz 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31853.log: gzip -5 --verbose -- 50.4% /var/log/ceph/ceph-client.admin.41383.log -- replaced with /var/log/ceph/ceph-client.admin.31853.log.gz 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44720.log 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32839.log.gz 2024-09-22T03:11:03.513 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41383.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41383.log.gz 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.35299.log 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28574.log 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44720.log.gz 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47377.log 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35299.log.gz 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.28574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29042.log 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.28574.log.gz 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.47377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38918.log 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47377.log.gz 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38024.log 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.29042.log.gz 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45209.log 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38918.log.gz 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38024.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.38024.log.gz 2024-09-22T03:11:03.514 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30607.log 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31433.log 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45209.log.gz 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30607.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30607.log.gz 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36591.log 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38520.log 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31433.log.gz 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39993.log 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36591.log.gz 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38520.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38520.log.gz -5 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36322.log 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46414.log 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39993.log.gz 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29884.log 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36322.log.gz 2024-09-22T03:11:03.515 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46414.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46414.log.gz 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35130.log 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35775.log 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29884.log.gz 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35130.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35130.log.gz 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40936.log 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44462.log 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35775.log.gz 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37855.log 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.40936.log.gz 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34523.log 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44462.log.gz 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36542.log 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37855.log.gz 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41125.log 2024-09-22T03:11:03.516 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34523.log.gz 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36542.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36542.log.gz 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31622.log 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37039.log 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41125.log.gz 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33636.log 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31622.log.gz 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37039.log: 50.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.37039.log.gz 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37597.log 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34343.log 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33636.log.gz 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41263.log 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37597.log.gz 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36910.log 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34343.log.gz 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41263.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41263.log.gz 2024-09-22T03:11:03.517 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37368.log 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38580.log 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36910.log.gz 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32266.log 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37368.log.gz 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38580.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38580.log.gz 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41828.log 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35250.log 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32266.log.gz 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44413.log 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41828.log.gz 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31713.log 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35250.log.gz 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42255.log 2024-09-22T03:11:03.518 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44413.log.gz 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31476.log 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31713.log.gz 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40999.log 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42255.log.gz 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33796.log 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31476.log.gz 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40999.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.40999.log.gz 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30342.log 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46743.log 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33796.log.gz 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30342.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30342.log.gz 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30747.log 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43576.log 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46743.log.gz 2024-09-22T03:11:03.519 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42513.log 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30747.log.gz 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30087.log 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43576.log.gz 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42513.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.42513.log.gz 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39266.log 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30796.log 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30087.log.gz 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38162.log 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39266.log.gz 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42465.log 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30796.log.gz 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31384.log 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38162.log.gz 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43129.log 2024-09-22T03:11:03.520 INFO:teuthology.orchestra.run.smithi145.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.42465.log.gz 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31384.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.31384.log.gz 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31993.log 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38422.log 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43129.log.gz 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31993.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31993.log.gz 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36732.log 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31922.log 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38422.log: /var/log/ceph/ceph-client.admin.36732.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38422.log.gz -5 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33894.log 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36732.log.gz 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36004.log 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31922.log.gz 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33894.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33894.log.gz 2024-09-22T03:11:03.521 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28495.log 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38778.log 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36004.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36004.log.gz 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.28495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33934.log 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.28495.log.gz 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38380.log 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38778.log.gz 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33934.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33934.log.gz 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30888.log 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41521.log 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38380.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38380.log.gz 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45495.log 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30888.log.gz 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34621.log 2024-09-22T03:11:03.522 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41521.log.gz 2024-09-22T03:11:03.523 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34034.log 2024-09-22T03:11:03.523 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45495.log.gz 2024-09-22T03:11:03.523 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40380.log 2024-09-22T03:11:03.523 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34621.log.gz 2024-09-22T03:11:03.523 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34034.log: gzip 49.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.34034.log.gz 2024-09-22T03:11:03.523 INFO:teuthology.orchestra.run.smithi145.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30216.log 2024-09-22T03:11:03.523 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45307.log 2024-09-22T03:11:03.523 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40380.log.gz 2024-09-22T03:11:03.523 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46785.log 2024-09-22T03:11:03.523 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30216.log.gz 2024-09-22T03:11:03.523 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44989.log 2024-09-22T03:11:03.523 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45307.log.gz 2024-09-22T03:11:03.523 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42404.log 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46785.log.gz 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39365.log 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44989.log.gz 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35041.log 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42404.log.gz 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41690.log 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39365.log.gz 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35041.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35041.log.gz 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45888.log 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41997.log 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41690.log.gz 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45888.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45888.log.gz 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46912.log 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40738.log 2024-09-22T03:11:03.524 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41997.log.gz 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46912.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46912.log.gz 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35655.log 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36193.log 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40738.log.gz 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31804.log 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35655.log.gz 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29988.log 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36193.log.gz 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46585.log 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.31804.log.gz 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr:gzip/var/log/ceph/ceph-client.admin.29988.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47164.log 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29988.log.gz 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38471.log 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46585.log.gz 2024-09-22T03:11:03.525 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.47164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39695.log 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47164.log.gz 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32175.log 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38471.log.gz 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39695.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39695.log.gz 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32175.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32175.log.gz 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44015.log 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33756.log 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30259.log 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44015.log.gz 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43427.log 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33756.log.gz 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-22T03:11:03.526 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34174.log 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30259.log.gz 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36073.log 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43427.log.gz 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45587.log 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34174.log.gz 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31902.log 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36073.log.gz 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33845.log 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45587.log.gz 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38689.log 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31902.log.gz 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44155.log 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.33845.log.gz 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37978.log 2024-09-22T03:11:03.527 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38689.log.gz 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45756.log 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44155.log.gz 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37978.log: 50.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.37978.log.gz 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40658.log 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38202.log 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45756.log.gz 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37228.log 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40658.log.gz 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33587.log 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38202.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38202.log.gz 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29312.log 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37228.log.gz 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33188.log 2024-09-22T03:11:03.528 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33587.log.gz 2024-09-22T03:11:03.529 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33143.log 2024-09-22T03:11:03.529 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29312.log.gz 2024-09-22T03:11:03.529 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33188.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33188.log.gz 2024-09-22T03:11:03.529 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29480.log 2024-09-22T03:11:03.529 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29314.log 2024-09-22T03:11:03.529 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33143.log.gz 2024-09-22T03:11:03.529 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29590.log 2024-09-22T03:11:03.529 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29480.log.gz 2024-09-22T03:11:03.529 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44626.log 2024-09-22T03:11:03.529 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29314.log.gz 2024-09-22T03:11:03.529 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29590.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29590.log.gz 2024-09-22T03:11:03.529 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43951.log 2024-09-22T03:11:03.529 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30933.log 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44626.log.gz 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40300.log 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43951.log.gz 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38073.log 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30933.log.gz 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40300.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40300.log.gz 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39646.log 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34901.log 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38073.log.gz 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39646.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39646.log.gz 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46102.log 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29128.log 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34901.log.gz 2024-09-22T03:11:03.530 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46102.log: gzip 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46102.log.gz -5 2024-09-22T03:11:03.531 INFO:teuthology.orchestra.run.smithi145.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45258.log 2024-09-22T03:11:03.531 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32042.log 2024-09-22T03:11:03.531 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29128.log.gz 2024-09-22T03:11:03.531 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30974.log 2024-09-22T03:11:03.531 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45258.log.gz 2024-09-22T03:11:03.531 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45347.log 2024-09-22T03:11:03.531 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32042.log.gz 2024-09-22T03:11:03.531 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40162.log 2024-09-22T03:11:03.531 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.30974.log.gz 2024-09-22T03:11:03.531 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32390.log 2024-09-22T03:11:03.531 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45347.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45347.log.gz 2024-09-22T03:11:03.531 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40916.log 2024-09-22T03:11:03.531 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40162.log.gz 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32390.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32390.log.gz 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34481.log 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35348.log 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40916.log.gz 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34303.log 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.34481.log.gz 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31524.log 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35348.log.gz 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39221.log 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34303.log.gz 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5/var/log/ceph/ceph-client.admin.31524.log: --verbose -- /var/log/ceph/ceph-client.admin.39456.log 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.31524.log.gz 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41641.log 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39221.log.gz 2024-09-22T03:11:03.532 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29311.log 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39456.log.gz 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35210.log 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41641.log.gz 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37677.log 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29311.log.gz 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46312.log 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35210.log.gz 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32308.log 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37677.log.gz 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31152.log 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.46312.log.gz 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32308.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32308.log.gz 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41908.log 2024-09-22T03:11:03.533 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33496.log 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31152.log.gz 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46415.log 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41908.log.gz 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46540.log 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33496.log.gz 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46415.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.46415.log.gz 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44284.log 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44204.log 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46540.log.gz 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44284.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44284.log.gz 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35557.log 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47332.log 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44204.log.gz 2024-09-22T03:11:03.534 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35557.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35557.log.gz 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30373.log 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.47332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35473.log 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.47332.log.gz 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.30373.log: gzip 66.7% -5 --verbose -- replaced with /var/log/ceph/ceph-client.0.30373.log.gz 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr: -- /var/log/ceph/ceph-client.admin.41868.log 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35473.log: gzip -5 49.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.35473.log.gz -- 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr: /var/log/ceph/ceph-client.admin.43009.log 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39815.log 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41868.log.gz 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43009.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43009.log.gz 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36990.log 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45636.log 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39815.log.gz 2024-09-22T03:11:03.535 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32879.log 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36990.log.gz 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34125.log 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45636.log.gz 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34223.log 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32879.log.gz 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40778.log 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34125.log.gz 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42871.log 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34223.log.gz 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38122.log 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40778.log.gz 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30301.log 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42871.log.gz 2024-09-22T03:11:03.536 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41303.log 2024-09-22T03:11:03.537 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38122.log.gz 2024-09-22T03:11:03.537 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44671.log 2024-09-22T03:11:03.537 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30301.log.gz 2024-09-22T03:11:03.537 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29482.log 2024-09-22T03:11:03.537 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41303.log.gz 2024-09-22T03:11:03.537 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37717.log 2024-09-22T03:11:03.537 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44671.log.gz 2024-09-22T03:11:03.537 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32350.log 2024-09-22T03:11:03.537 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29482.log.gz 2024-09-22T03:11:03.537 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36144.log 2024-09-22T03:11:03.537 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37717.log.gz 2024-09-22T03:11:03.537 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37179.log 2024-09-22T03:11:03.537 INFO:teuthology.orchestra.run.smithi145.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.32350.log.gz 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33321.log 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36144.log.gz 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38646.log 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37179.log.gz 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33321.log: 50.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.33321.log.gz 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39147.log 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31664.log 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38646.log.gz 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42126.log 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39147.log.gz 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32650.log 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31664.log.gz 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35735.log 2024-09-22T03:11:03.538 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.42126.log.gz 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36660.log 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32650.log.gz 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34054.log 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35735.log.gz 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46828.log 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36660.log.gz 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42562.log 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34054.log.gz 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41739.log 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46828.log.gz 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43714.log 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42562.log.gz 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47038.log 2024-09-22T03:11:03.539 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41739.log.gz 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43714.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43714.log.gz 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43532.log 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.47038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46228.log 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47038.log.gz 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39187.log 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43532.log.gz 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42960.log 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46228.log.gz 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46543.log 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39187.log.gz 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40867.log 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42960.log.gz 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46543.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46543.log.gz 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39555.log 2024-09-22T03:11:03.540 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39009.log 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40867.log.gz 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39555.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39555.log.gz 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35695.log 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31762.log 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39009.log.gz 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42344.log 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35695.log.gz 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32699.log 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31762.log.gz 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42344.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42344.log.gz 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36870.log 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32699.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32699.log.gz 2024-09-22T03:11:03.541 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37815.log 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36870.log.gz 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43288.log 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37815.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37815.log.gz 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39597.log 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32601.log 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43288.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43288.log.gz 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36500.log 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39597.log.gz 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47122.log 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32601.log.gz 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45933.log 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36500.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36500.log.gz 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.47122.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47122.log.gz 2024-09-22T03:11:03.542 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32091.log 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32481.log 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45933.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45933.log.gz 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29442.log 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32091.log.gz 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47290.log 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32481.log.gz 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44909.log 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29442.log.gz 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.47290.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47290.log.gz 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45716.log 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46270.log 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44909.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44909.log.gz 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45716.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45716.log.gz 2024-09-22T03:11:03.543 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45167.log 2024-09-22T03:11:03.544 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36402.log 2024-09-22T03:11:03.544 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46270.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46270.log.gz 2024-09-22T03:11:03.544 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45167.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45167.log.gz 2024-09-22T03:11:03.544 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46413.log 2024-09-22T03:11:03.544 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31573.log 2024-09-22T03:11:03.544 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36402.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.36402.log.gz 2024-09-22T03:11:03.544 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30086.log 2024-09-22T03:11:03.544 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46413.log.gz 2024-09-22T03:11:03.544 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31103.log 2024-09-22T03:11:03.544 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31573.log.gz 2024-09-22T03:11:03.544 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35517.log 2024-09-22T03:11:03.544 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30086.log.gz 2024-09-22T03:11:03.544 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31014.log 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.31103.log.gz 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43049.log 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35517.log.gz 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42751.log 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.31014.log.gz 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43616.log 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.43049.log.gz 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42791.log 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42751.log.gz 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43616.log: gzip -5 50.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.43616.log.gz /var/log/ceph/ceph-client.admin.43797.log 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29842.log 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42791.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42791.log.gz 2024-09-22T03:11:03.545 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40115.log 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.43797.log.gz 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41601.log 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29842.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29842.log.gz 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34761.log 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40115.log.gz 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39775.log 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.41601.log.gz 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40518.log 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34761.log: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.34761.log.gz 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36362.log 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39775.log.gz 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31335.log 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40518.log.gz 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34661.log 2024-09-22T03:11:03.546 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36362.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36362.log.gz 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35170.log 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.31335.log.gz 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34661.log: gzip -5 --verbose 50.0% -- -- replaced with /var/log/ceph/ceph-client.admin.34661.log.gz /var/log/ceph/ceph-client.admin.42206.log 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43756.log 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35170.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35170.log.gz 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42046.log 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42206.log.gz 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28730.log 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.43756.log.gz 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37915.log 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42046.log.gz 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.28730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29758.log 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.28730.log.gz 2024-09-22T03:11:03.547 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40033.log 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37915.log.gz 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43089.log 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29758.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.29758.log.gz 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38827.log 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.40033.log.gz 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43089.log: gzip -5 --verbose -- 50.0% /var/log/ceph/ceph-client.admin.39107.log -- replaced with /var/log/ceph/ceph-client.admin.43089.log.gz 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37459.log 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38827.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38827.log.gz 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32979.log 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39107.log.gz 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37459.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37459.log.gz -5 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45538.log 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38282.log 2024-09-22T03:11:03.548 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32979.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32979.log.gz 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44364.log 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45538.log.gz 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38282.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38282.log.gz 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43267.log 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44364.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44364.log.gz 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32435.log 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43490.log 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.43267.log.gz 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32435.log: gzip -5 --verbose 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32435.log.gz 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr: -- /var/log/ceph/ceph-client.admin.33985.log 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43490.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43490.log.gz 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41432.log 2024-09-22T03:11:03.549 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43218.log 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33985.log.gz 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31054.log 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41432.log.gz 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42653.log 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43218.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43218.log.gz 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45069.log 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31054.log.gz 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44502.log 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42653.log.gz 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33405.log 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45069.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45069.log.gz/var/log/ceph/ceph-client.admin.44502.log: 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr:gzip 49.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.44502.log.gz --verbose 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr: -- /var/log/ceph/ceph-client.admin.40340.log 2024-09-22T03:11:03.550 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34263.log 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33405.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33405.log.gz 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46954.log 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40340.log.gz 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37508.log 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34263.log.gz 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34802.log 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46954.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46954.log.gz 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37508.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37508.log.gz 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37088.log 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38869.log 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34802.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34802.log.gz 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42304.log 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37088.log.gz 2024-09-22T03:11:03.551 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42605.log 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38869.log.gz 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43931.log 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42304.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42304.log.gz 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41343.log 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42605.log.gz 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43931.log: gzip -5 --verbose 49.6% -- -- replaced with /var/log/ceph/ceph-client.admin.43931.log.gz /var/log/ceph/ceph-client.admin.40698.log 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32790.log 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41343.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.41343.log.gz 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40698.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40698.log.gz 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42166.log 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29632.log 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32790.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32790.log.gz 2024-09-22T03:11:03.552 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44542.log 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.42166.log.gz 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46996.log 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29632.log.gz 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47248.log 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44542.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44542.log.gz 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42702.log 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.46996.log.gz 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.47248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36640.log 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47248.log.gz 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32133.log 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42702.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42702.log.gz 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46412.log 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36640.log.gz 2024-09-22T03:11:03.553 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32133.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32133.log.gz 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42831.log 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35864.log 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46412.log.gz 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30173.log 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42831.log.gz 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35864.log: gzip -5 --verbose -- 49.6% /var/log/ceph/ceph-client.admin.41788.log 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35864.log.gz 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30845.log 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30173.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30173.log.gz 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41788.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.41788.log.gz 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36781.log 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29438.log 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.30845.log.gz 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36781.log: gzip 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36781.log.gz -5 2024-09-22T03:11:03.554 INFO:teuthology.orchestra.run.smithi145.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45676.log 2024-09-22T03:11:03.555 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44324.log 2024-09-22T03:11:03.555 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29438.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.29438.log.gz 2024-09-22T03:11:03.555 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37248.log 2024-09-22T03:11:03.555 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45676.log.gz 2024-09-22T03:11:03.555 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40254.log 2024-09-22T03:11:03.555 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44324.log.gz 2024-09-22T03:11:03.555 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44769.log 2024-09-22T03:11:03.555 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37248.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37248.log.gz 2024-09-22T03:11:03.555 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41481.log 2024-09-22T03:11:03.555 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40254.log.gz 2024-09-22T03:11:03.555 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44769.log: gzip -5 --verbose -- 50.4% /var/log/ceph/ceph-client.admin.39735.log 2024-09-22T03:11:03.555 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44769.log.gz 2024-09-22T03:11:03.555 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33676.log 2024-09-22T03:11:03.556 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41481.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41481.log.gz 2024-09-22T03:11:03.556 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40798.log 2024-09-22T03:11:03.556 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39735.log.gz 2024-09-22T03:11:03.556 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35606.log 2024-09-22T03:11:03.556 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33676.log.gz 2024-09-22T03:11:03.556 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34992.log 2024-09-22T03:11:03.556 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40798.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40798.log.gz 2024-09-22T03:11:03.556 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35606.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35606.log.gz 2024-09-22T03:11:03.556 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32741.log 2024-09-22T03:11:03.556 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36053.log 2024-09-22T03:11:03.556 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34992.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34992.log.gz 2024-09-22T03:11:03.556 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32741.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32741.log.gz 2024-09-22T03:11:03.557 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43407.log 2024-09-22T03:11:03.557 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.36053.log: /var/log/ceph/ceph-client.admin.31244.log 2024-09-22T03:11:03.557 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.36053.log.gz 2024-09-22T03:11:03.557 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38967.log 2024-09-22T03:11:03.557 INFO:teuthology.orchestra.run.smithi145.stderr: 48.0% -- replaced with /var/log/ceph/ceph-client.admin.43407.log.gz 2024-09-22T03:11:03.557 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44860.log 2024-09-22T03:11:03.557 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31244.log.gz 2024-09-22T03:11:03.557 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42384.log 2024-09-22T03:11:03.557 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38967.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38967.log.gz 2024-09-22T03:11:03.557 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33425.log 2024-09-22T03:11:03.557 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.44860.log.gz 2024-09-22T03:11:03.557 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.42384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31194.log 2024-09-22T03:11:03.558 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.42384.log.gz 2024-09-22T03:11:03.558 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38729.log 2024-09-22T03:11:03.558 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33425.log: 47.6% -- replaced with /var/log/ceph/ceph-client.admin.33425.log.gz 2024-09-22T03:11:03.558 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37914.log 2024-09-22T03:11:03.558 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.31194.log.gz 2024-09-22T03:11:03.558 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32215.log 2024-09-22T03:11:03.558 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.38729.log.gz 2024-09-22T03:11:03.558 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43889.log 2024-09-22T03:11:03.558 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37914.log.gz 2024-09-22T03:11:03.558 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37130.log 2024-09-22T03:11:03.558 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32215.log.gz 2024-09-22T03:11:03.558 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41174.log 2024-09-22T03:11:03.558 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43889.log.gz 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29069.log 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37130.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37130.log.gz 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41948.log 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41174.log.gz 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37557.log 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr: 66.7% -- replaced with /var/log/ceph/ceph-client.admin.29069.log.gz 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30656.log 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.41948.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.41948.log.gz 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29212.log 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.37557.log.gz 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34950.log 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30656.log.gz 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28986.log 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29212.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29212.log.gz 2024-09-22T03:11:03.559 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43358.log 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.34950.log.gz 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47206.log 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.28986.log: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.28986.log.gz 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43358.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.43358.log.gz 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29800.log 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45845.log 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.47206.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47206.log.gz 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29800.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.29800.log.gz 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35090.log 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38242.log 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45845.log: 49.2% -- replaced with /var/log/ceph/ceph-client.admin.45845.log.gz 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44949.log 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.35090.log.gz 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31293.log 2024-09-22T03:11:03.560 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38242.log.gz 2024-09-22T03:11:03.561 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.44949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47080.log 2024-09-22T03:11:03.561 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.44949.log.gz 2024-09-22T03:11:03.561 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.31293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38331.log 2024-09-22T03:11:03.561 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.31293.log.gz 2024-09-22T03:11:03.561 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.47080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32919.log 2024-09-22T03:11:03.561 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.47080.log.gz 2024-09-22T03:11:03.561 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37637.log 2024-09-22T03:11:03.561 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38331.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38331.log.gz 2024-09-22T03:11:03.561 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34383.log 2024-09-22T03:11:03.561 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.32919.log.gz 2024-09-22T03:11:03.561 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35428.log 2024-09-22T03:11:03.561 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37637.log.gz 2024-09-22T03:11:03.561 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43665.log 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34383.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34383.log.gz 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.35428.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.35428.log.gz 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45976.log 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45796.log 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.43665.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.43665.log.gz 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39904.log 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.45976.log.gz 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.45796.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27419.log 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.45796.log.gz 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34712.log 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39904.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.39904.log.gz 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph.tmp-client.admin.27419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30705.log 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr: 67.7% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27419.log.gz 2024-09-22T03:11:03.562 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.34712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37319.log 2024-09-22T03:11:03.563 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.34712.log.gz 2024-09-22T03:11:03.563 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33716.log 2024-09-22T03:11:03.563 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.30705.log: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.30705.log.gz 2024-09-22T03:11:03.563 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36830.log 2024-09-22T03:11:03.563 INFO:teuthology.orchestra.run.smithi145.stderr: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.37319.log.gz 2024-09-22T03:11:03.563 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46870.log 2024-09-22T03:11:03.563 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.33716.log.gz 2024-09-22T03:11:03.563 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37414.log 2024-09-22T03:11:03.563 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36830.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36830.log.gz 2024-09-22T03:11:03.563 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.46870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28757.log 2024-09-22T03:11:03.563 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.46870.log.gz 2024-09-22T03:11:03.563 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.37414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39855.log 2024-09-22T03:11:03.563 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.37414.log.gz 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.28757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47417.log 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr: 50.8% -- replaced with /var/log/ceph/ceph-client.admin.28757.log.gz 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36950.log 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.39855.log.gz 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.47417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32521.log 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.47417.log.gz 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36282.log 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36950.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.36950.log.gz 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.32521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33363.log 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.32521.log.gz 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.36282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38560.log 50.0% 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36282.log.gz 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40211.log 2024-09-22T03:11:03.564 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.33363.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.33363.log.gz 2024-09-22T03:11:03.565 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.38560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39411.log 2024-09-22T03:11:03.565 INFO:teuthology.orchestra.run.smithi145.stderr: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.38560.log.gz 2024-09-22T03:11:03.565 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.40211.log: 49.6% -- replaced with /var/log/ceph/ceph-client.admin.40211.log.gz 2024-09-22T03:11:03.565 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.39411.log: 50.0% -- replaced with /var/log/ceph/ceph-client.admin.39411.log.gz 2024-09-22T03:11:03.688 INFO:teuthology.orchestra.run.smithi145.stderr: 89.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-22T03:11:05.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-22T03:11:20.057 INFO:teuthology.orchestra.run.smithi145.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-22T03:11:20.387 INFO:teuthology.orchestra.run.smithi194.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-22T03:11:20.870 INFO:teuthology.orchestra.run.smithi145.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-22T03:11:20.872 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-22T03:11:20.872 INFO:teuthology.orchestra.run.smithi145.stderr:real 0m17.504s 2024-09-22T03:11:20.872 INFO:teuthology.orchestra.run.smithi145.stderr:user 0m33.236s 2024-09-22T03:11:20.872 INFO:teuthology.orchestra.run.smithi145.stderr:sys 0m1.366s 2024-09-22T03:11:23.962 INFO:teuthology.orchestra.run.smithi194.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-22T03:11:23.964 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-09-22T03:11:23.964 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m20.560s 2024-09-22T03:11:23.964 INFO:teuthology.orchestra.run.smithi194.stderr:user 0m36.257s 2024-09-22T03:11:23.964 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m1.271s 2024-09-22T03:11:23.964 INFO:tasks.ceph:Archiving logs... 2024-09-22T03:11:23.964 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914713/remote/smithi145/log 2024-09-22T03:11:23.965 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T03:11:29.727 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914713/remote/smithi194/log 2024-09-22T03:11:29.728 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-22T03:11:35.531 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-22T03:11:35.540 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-22T03:11:35.540 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T03:11:35.543 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-22T03:11:35.638 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-22T03:11:35.647 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-22T03:11:35.647 DEBUG:teuthology.orchestra.run.smithi145:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T03:11:35.649 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-22T03:11:35.664 INFO:teuthology.orchestra.run.smithi145.stderr:bash: line 1: ntpq: command not found 2024-09-22T03:11:35.665 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-22T03:11:35.669 INFO:teuthology.orchestra.run.smithi145.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T03:11:35.669 INFO:teuthology.orchestra.run.smithi145.stdout:=============================================================================== 2024-09-22T03:11:35.669 INFO:teuthology.orchestra.run.smithi145.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 -58us[ -64us] +/- 52ms 2024-09-22T03:11:35.669 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 +232us[ +225us] +/- 56ms 2024-09-22T03:11:35.669 INFO:teuthology.orchestra.run.smithi145.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 -220us[ -226us] +/- 73ms 2024-09-22T03:11:35.669 INFO:teuthology.orchestra.run.smithi145.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:11:35.670 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-22T03:11:35.670 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-22T03:11:35.670 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 -46us[ -57us] +/- 52ms 2024-09-22T03:11:35.670 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 +219us[ +209us] +/- 56ms 2024-09-22T03:11:35.670 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 -228us[ -239us] +/- 73ms 2024-09-22T03:11:35.671 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-22T03:11:35.671 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-22T03:11:35.680 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-22T03:11:35.681 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-22T03:11:35.688 DEBUG:teuthology.orchestra.run.smithi145:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T03:11:35.786 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-22T03:11:35.853 DEBUG:teuthology.orchestra.run.smithi145:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-22T03:11:35.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:11:35.882 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-22T03:11:35.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:11:35.912 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-22T03:11:35.921 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-22T03:11:35.960 INFO:teuthology.task.internal:Duration was 957.571863 seconds 2024-09-22T03:11:35.960 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-22T03:11:36.005 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-22T03:11:36.005 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T03:11:36.008 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-22T03:11:36.046 INFO:teuthology.orchestra.run.smithi145.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T03:11:36.049 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-22T03:11:36.327 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-22T03:11:36.327 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi145.front.sepia.ceph.com 2024-09-22T03:11:36.328 DEBUG:teuthology.orchestra.run.smithi145:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T03:11:36.348 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-09-22T03:11:36.348 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-22T03:11:36.401 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-22T03:11:36.401 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T03:11:36.404 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-22T03:11:36.469 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-22T03:11:36.469 DEBUG:teuthology.orchestra.run.smithi145:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T03:11:36.471 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-22T03:11:36.606 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-22T03:11:36.617 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-22T03:11:36.617 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T03:11:36.642 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-22T03:11:36.668 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-22T03:11:36.677 DEBUG:teuthology.orchestra.run.smithi145:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T03:11:36.685 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-22T03:11:36.706 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = core 2024-09-22T03:11:36.731 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-09-22T03:11:36.752 DEBUG:teuthology.orchestra.run.smithi145:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T03:11:36.777 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:11:36.777 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-22T03:11:36.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-22T03:11:36.807 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-22T03:11:36.817 INFO:teuthology.task.internal:Transferring archived files... 2024-09-22T03:11:36.818 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914713/remote/smithi145 2024-09-22T03:11:36.818 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T03:11:36.851 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-21_21:56:02-crimson-rados-squid-distro-crimson-smithi/7914713/remote/smithi194 2024-09-22T03:11:36.851 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-22T03:11:36.883 INFO:teuthology.task.internal:Removing archive directory... 2024-09-22T03:11:36.884 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T03:11:36.888 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-22T03:11:36.934 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-22T03:11:36.945 INFO:teuthology.task.internal:Not uploading archives. 2024-09-22T03:11:36.945 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-22T03:11:36.955 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-22T03:11:36.955 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T03:11:36.957 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-22T03:11:36.970 INFO:teuthology.orchestra.run.smithi145.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 03:11 /home/ubuntu/cephtest 2024-09-22T03:11:36.989 INFO:teuthology.orchestra.run.smithi194.stdout: 265325 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 22 03:11 /home/ubuntu/cephtest 2024-09-22T03:11:36.989 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-22T03:11:37.000 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-22T03:11:37.021 INFO:teuthology.run:Summary data: description: crimson-rados/thrash_simple/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/simple thrashosds-health workloads/admin_socket_objecter_requests} duration: 957.5718631744385 flavor: crimson owner: scheduled_teuthology@teuthology success: true 2024-09-22T03:11:37.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-22T03:11:37.100 INFO:teuthology.run:pass