2023-06-26T02:56:42.782 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-26T02:56:42.783 INFO:teuthology.results:seed: '2120'
2023-06-26T02:57:43.362 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-26T02:57:43.365 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-06-26T14:58:34.724 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2023-06-26T14:58:57.368 INFO:scrape:Found 20 jobs
2023-06-26T14:58:59.465 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 18.0.0-4629-g1e8a39f3 (1e8a39f359d8481bb3038b461063c87384bf3ee8) reef (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x120) [0x7f5ab3f7c7ff]
,  2: (ceph::register_assert_context(ceph::common::CephContext*)+0) [0x7f5ab3f7ca2a]

2023-06-26T14:58:59.468 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T03:33:31.145+0000 7f99d9e15700 -1 WARNING: the following dangerous and experimental features are enabled: crimson
, 2023-06-26T03:33:31.154+0000 7f99d9e15700 -1 WARNING: the following dangerous and experimental features are enabled: crimson
, set osd.3 primary-affinity to 1 (8655362)

2023-06-26T14:58:59.469 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T03:33:37.084 INFO:teuthology.orchestra.run.smithi061.stdout:
, dumped all
, 2023-06-26T03:33:37.098 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-06-26T03:33:36.128532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1203408841,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13150,"num_read_kb":9768595,"num_write":8796,"num_write_kb":2542536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":496250954,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7560,"ondisk_log_size":7560,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":2804784,"kb_used_data":2578576,"kb_used_omap":0,"kb_used_meta":226176,"kb_avail":374682576,"statfs":{"total":386547056640,"available":383674957824,"internally_reserved":0,"allocated":2640461824,"data_stored":2620665169,"data_compressed":89751,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":231604224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.135159"},"pg_stats":[{"pgid":"3.f","version":"22'474","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-26T03:33:31.157904+0000","last_change":"2023-06-26T03:33:19.881706+0000","last_active":"2023-06-26T03:33:31.157904+0000","last_peered":"2023-06-26T03:33:31.157904+0000","last_clean":"2023-06-26T03:33:31.157904+0000","last_became_active":"2023-06-26T03:33:19.878659+0000","last_became_peered":"2023-06-26T03:33:19.878659+0000","last_unstale":"2023-06-26T03:33:31.157904+0000","last_undegraded":"2023-06-26T03:33:31.157904+0000","last_fullsized":"2023-06-26T03:33:31.157904+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12827,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":52336274,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"32'432","reported_seq":884,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.965133+0000","last_change":"2023-06-26T03:33:14.046533+0000","last_active":"2023-06-26T03:33:32.965133+0000","last_peered":"2023-06-26T03:33:32.965133+0000","last_clean":"2023-06-26T03:33:32.965133+0000","last_became_active":"2023-06-26T03:33:14.038723+0000","last_became_peered":"2023-06-26T03:33:14.038723+0000","last_unstale":"2023-06-26T03:33:32.965133+0000","last_undegraded":"2023-06-26T03:33:32.965133+0000","last_fullsized":"2023-06-26T03:33:32.965133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72432385,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":654,"num_read_kb":446879,"num_write":538,"num_write_kb":157922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":48628713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"31'519","reported_seq":1068,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.020737+0000","last_change":"2023-06-26T03:28:12.935366+0000","last_active":"2023-06-26T03:33:32.020737+0000","last_peered":"2023-06-26T03:33:32.020737+0000","last_clean":"2023-06-26T03:33:32.020737+0000","last_became_active":"2023-06-26T03:28:12.932005+0000","last_became_peered":"2023-06-26T03:28:12.932005+0000","last_unstale":"2023-06-26T03:33:32.020737+0000","last_undegraded":"2023-06-26T03:33:32.020737+0000","last_fullsized":"2023-06-26T03:33:32.020737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101294360,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1025,"num_read_kb":749085,"num_write":655,"num_write_kb":190173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"25'511","reported_seq":1025,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.021337+0000","last_change":"2023-06-26T03:28:12.935230+0000","last_active":"2023-06-26T03:33:32.021337+0000","last_peered":"2023-06-26T03:33:32.021337+0000","last_clean":"2023-06-26T03:33:32.021337+0000","last_became_active":"2023-06-26T03:28:12.932318+0000","last_became_peered":"2023-06-26T03:28:12.932318+0000","last_unstale":"2023-06-26T03:33:32.021337+0000","last_undegraded":"2023-06-26T03:33:32.021337+0000","last_fullsized":"2023-06-26T03:33:32.021337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91308065,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":956,"num_read_kb":716586,"num_write":640,"num_write_kb":190106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'427","reported_seq":908,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.971256+0000","last_change":"2023-06-26T03:28:12.971493+0000","last_active":"2023-06-26T03:33:32.971256+0000","last_peered":"2023-06-26T03:33:32.971256+0000","last_clean":"2023-06-26T03:33:32.971256+0000","last_became_active":"2023-06-26T03:28:12.968594+0000","last_became_peered":"2023-06-26T03:28:12.968594+0000","last_unstale":"2023-06-26T03:33:32.971256+0000","last_undegraded":"2023-06-26T03:33:32.971256+0000","last_fullsized":"2023-06-26T03:33:32.971256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79811021,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":879,"num_read_kb":643829,"num_write":538,"num_write_kb":157649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'446","reported_seq":962,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.013982+0000","last_change":"2023-06-26T03:33:11.024784+0000","last_active":"2023-06-26T03:33:32.013982+0000","last_peered":"2023-06-26T03:33:32.013982+0000","last_clean":"2023-06-26T03:33:32.013982+0000","last_became_active":"2023-06-26T03:33:11.021791+0000","last_became_peered":"2023-06-26T03:33:11.021791+0000","last_unstale":"2023-06-26T03:33:32.013982+0000","last_undegraded":"2023-06-26T03:33:32.013982+0000","last_fullsized":"2023-06-26T03:33:32.013982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83928274,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":600578,"num_write":555,"num_write_kb":161312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":51237268,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"28'474","reported_seq":1029,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.024984+0000","last_change":"2023-06-26T03:33:11.019328+0000","last_active":"2023-06-26T03:33:32.024984+0000","last_peered":"2023-06-26T03:33:32.024984+0000","last_clean":"2023-06-26T03:33:32.024984+0000","last_became_active":"2023-06-26T03:33:11.015940+0000","last_became_peered":"2023-06-26T03:33:11.015940+0000","last_unstale":"2023-06-26T03:33:32.024984+0000","last_undegraded":"2023-06-26T03:33:32.024984+0000","last_fullsized":"2023-06-26T03:33:32.024984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85173510,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":867,"num_read_kb":640592,"num_write":603,"num_write_kb":177355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":54241940,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"29'408","reported_seq":851,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.020899+0000","last_change":"2023-06-26T03:28:12.988945+0000","last_active":"2023-06-26T03:33:32.020899+0000","last_peered":"2023-06-26T03:33:32.020899+0000","last_clean":"2023-06-26T03:33:32.020899+0000","last_became_active":"2023-06-26T03:28:12.977936+0000","last_became_peered":"2023-06-26T03:28:12.977936+0000","last_unstale":"2023-06-26T03:33:32.020899+0000","last_undegraded":"2023-06-26T03:33:32.020899+0000","last_fullsized":"2023-06-26T03:33:32.020899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72735505,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":793,"num_read_kb":641636,"num_write":511,"num_write_kb":150735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.981112+0000","last_change":"2023-06-26T03:33:04.032677+0000","last_active":"2023-06-26T03:33:32.981112+0000","last_peered":"2023-06-26T03:33:32.981112+0000","last_clean":"2023-06-26T03:33:32.981112+0000","last_became_active":"2023-06-26T03:33:04.021706+0000","last_became_peered":"2023-06-26T03:33:04.021706+0000","last_unstale":"2023-06-26T03:33:32.981112+0000","last_undegraded":"2023-06-26T03:33:32.981112+0000","last_fullsized":"2023-06-26T03:33:32.981112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'444","reported_seq":788,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-26T03:33:31.152204+0000","last_change":"2023-06-26T03:33:11.003758+0000","last_active":"2023-06-26T03:33:31.152204+0000","last_peered":"2023-06-26T03:33:31.152204+0000","last_clean":"2023-06-26T03:33:31.152204+0000","last_became_active":"2023-06-26T03:33:11.000588+0000","last_became_peered":"2023-06-26T03:33:11.000588+0000","last_unstale":"2023-06-26T03:33:31.152204+0000","last_undegraded":"2023-06-26T03:33:31.152204+0000","last_fullsized":"2023-06-26T03:33:31.152204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4153243,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":661489,"num_write":438,"num_write_kb":127217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":47436104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.023927+0000","last_change":"2023-06-26T03:33:04.005514+0000","last_active":"2023-06-26T03:33:32.023927+0000","last_peered":"2023-06-26T03:33:32.023927+0000","last_clean":"2023-06-26T03:33:32.023927+0000","last_became_active":"2023-06-26T03:33:03.995911+0000","last_became_peered":"2023-06-26T03:33:03.995911+0000","last_unstale":"2023-06-26T03:33:32.023927+0000","last_undegraded":"2023-06-26T03:33:32.023927+0000","last_fullsized":"2023-06-26T03:33:32.023927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'415","reported_seq":927,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.991289+0000","last_change":"2023-06-26T03:33:16.028748+0000","last_active":"2023-06-26T03:33:32.991289+0000","last_peered":"2023-06-26T03:33:32.991289+0000","last_clean":"2023-06-26T03:33:32.991289+0000","last_became_active":"2023-06-26T03:33:16.024169+0000","last_became_peered":"2023-06-26T03:33:16.024169+0000","last_unstale":"2023-06-26T03:33:32.991289+0000","last_undegraded":"2023-06-26T03:33:32.991289+0000","last_fullsized":"2023-06-26T03:33:32.991289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74465570,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":646413,"num_write":517,"num_write_kb":153491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":43055054,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":68,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-26T03:33:31.146923+0000","last_change":"2023-06-26T03:33:03.971932+0000","last_active":"2023-06-26T03:33:31.146923+0000","last_peered":"2023-06-26T03:33:31.146923+0000","last_clean":"2023-06-26T03:33:31.146923+0000","last_became_active":"2023-06-26T03:33:03.962368+0000","last_became_peered":"2023-06-26T03:33:03.962368+0000","last_unstale":"2023-06-26T03:33:31.146923+0000","last_undegraded":"2023-06-26T03:33:31.146923+0000","last_fullsized":"2023-06-26T03:33:31.146923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'467","reported_seq":1001,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.966109+0000","last_change":"2023-06-26T03:33:14.037875+0000","last_active":"2023-06-26T03:33:32.966109+0000","last_peered":"2023-06-26T03:33:32.966109+0000","last_clean":"2023-06-26T03:33:32.966109+0000","last_became_active":"2023-06-26T03:33:14.032805+0000","last_became_peered":"2023-06-26T03:33:14.032805+0000","last_unstale":"2023-06-26T03:33:32.966109+0000","last_undegraded":"2023-06-26T03:33:32.966109+0000","last_fullsized":"2023-06-26T03:33:32.966109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87241101,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":829,"num_read_kb":655593,"num_write":593,"num_write_kb":176603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":51495841,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.007855+0000","last_change":"2023-06-26T03:33:03.975638+0000","last_active":"2023-06-26T03:33:32.007855+0000","last_peered":"2023-06-26T03:33:32.007855+0000","last_clean":"2023-06-26T03:33:32.007855+0000","last_became_active":"2023-06-26T03:33:03.972496+0000","last_became_peered":"2023-06-26T03:33:03.972496+0000","last_unstale":"2023-06-26T03:33:32.007855+0000","last_undegraded":"2023-06-26T03:33:32.007855+0000","last_fullsized":"2023-06-26T03:33:32.007855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":207,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.969923+0000","last_change":"2023-06-26T03:33:04.001440+0000","last_active":"2023-06-26T03:33:32.969923+0000","last_peered":"2023-06-26T03:33:32.969923+0000","last_clean":"2023-06-26T03:33:32.969923+0000","last_became_active":"2023-06-26T03:33:03.994797+0000","last_became_peered":"2023-06-26T03:33:03.994797+0000","last_unstale":"2023-06-26T03:33:32.969923+0000","last_undegraded":"2023-06-26T03:33:32.969923+0000","last_fullsized":"2023-06-26T03:33:32.969923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'349","reported_seq":780,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.008730+0000","last_change":"2023-06-26T03:33:13.016200+0000","last_active":"2023-06-26T03:33:32.008730+0000","last_peered":"2023-06-26T03:33:32.008730+0000","last_clean":"2023-06-26T03:33:32.008730+0000","last_became_active":"2023-06-26T03:33:13.013216+0000","last_became_peered":"2023-06-26T03:33:13.013216+0000","last_unstale":"2023-06-26T03:33:32.008730+0000","last_undegraded":"2023-06-26T03:33:32.008730+0000","last_fullsized":"2023-06-26T03:33:32.008730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59118799,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":657,"num_read_kb":512776,"num_write":443,"num_write_kb":129765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":37455466,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.023296+0000","last_change":"2023-06-26T03:33:03.965798+0000","last_active":"2023-06-26T03:33:32.023296+0000","last_peered":"2023-06-26T03:33:32.023296+0000","last_clean":"2023-06-26T03:33:32.023296+0000","last_became_active":"2023-06-26T03:33:03.956975+0000","last_became_peered":"2023-06-26T03:33:03.956975+0000","last_unstale":"2023-06-26T03:33:32.023296+0000","last_undegraded":"2023-06-26T03:33:32.023296+0000","last_fullsized":"2023-06-26T03:33:32.023296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'499","reported_seq":1073,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.989923+0000","last_change":"2023-06-26T03:33:18.067146+0000","last_active":"2023-06-26T03:33:32.989923+0000","last_peered":"2023-06-26T03:33:32.989923+0000","last_clean":"2023-06-26T03:33:32.989923+0000","last_became_active":"2023-06-26T03:33:18.060805+0000","last_became_peered":"2023-06-26T03:33:18.060805+0000","last_unstale":"2023-06-26T03:33:32.989923+0000","last_undegraded":"2023-06-26T03:33:32.989923+0000","last_fullsized":"2023-06-26T03:33:32.989923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98419274,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":919,"num_read_kb":664725,"num_write":629,"num_write_kb":185815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":51982509,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.972318+0000","last_change":"2023-06-26T03:33:03.975155+0000","last_active":"2023-06-26T03:33:32.972318+0000","last_peered":"2023-06-26T03:33:32.972318+0000","last_clean":"2023-06-26T03:33:32.972318+0000","last_became_active":"2023-06-26T03:33:03.966827+0000","last_became_peered":"2023-06-26T03:33:03.966827+0000","last_unstale":"2023-06-26T03:33:32.972318+0000","last_undegraded":"2023-06-26T03:33:32.972318+0000","last_fullsized":"2023-06-26T03:33:32.972318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'667","reported_seq":1350,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.965272+0000","last_change":"2023-06-26T03:28:12.995749+0000","last_active":"2023-06-26T03:33:32.965272+0000","last_peered":"2023-06-26T03:33:32.965272+0000","last_clean":"2023-06-26T03:33:32.965272+0000","last_became_active":"2023-06-26T03:28:12.992276+0000","last_became_peered":"2023-06-26T03:28:12.992276+0000","last_unstale":"2023-06-26T03:33:32.965272+0000","last_undegraded":"2023-06-26T03:33:32.965272+0000","last_fullsized":"2023-06-26T03:33:32.965272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124811775,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1313,"num_read_kb":983801,"num_write":839,"num_write_kb":243360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'342","reported_seq":724,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.975612+0000","last_change":"2023-06-26T03:28:12.985762+0000","last_active":"2023-06-26T03:33:32.975612+0000","last_peered":"2023-06-26T03:33:32.975612+0000","last_clean":"2023-06-26T03:33:32.975612+0000","last_became_active":"2023-06-26T03:28:12.976594+0000","last_became_peered":"2023-06-26T03:28:12.976594+0000","last_unstale":"2023-06-26T03:33:32.975612+0000","last_undegraded":"2023-06-26T03:33:32.975612+0000","last_fullsized":"2023-06-26T03:33:32.975612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64262797,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":688,"num_read_kb":481691,"num_write":421,"num_write_kb":122131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.970968+0000","last_change":"2023-06-26T03:33:03.991445+0000","last_active":"2023-06-26T03:33:32.970968+0000","last_peered":"2023-06-26T03:33:32.970968+0000","last_clean":"2023-06-26T03:33:32.970968+0000","last_became_active":"2023-06-26T03:33:03.988463+0000","last_became_peered":"2023-06-26T03:33:03.988463+0000","last_unstale":"2023-06-26T03:33:32.970968+0000","last_undegraded":"2023-06-26T03:33:32.970968+0000","last_fullsized":"2023-06-26T03:33:32.970968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.011810+0000","last_change":"2023-06-26T03:33:03.975627+0000","last_active":"2023-06-26T03:33:32.011810+0000","last_peered":"2023-06-26T03:33:32.011810+0000","last_clean":"2023-06-26T03:33:32.011810+0000","last_became_active":"2023-06-26T03:33:03.972087+0000","last_became_peered":"2023-06-26T03:33:03.972087+0000","last_unstale":"2023-06-26T03:33:32.011810+0000","last_undegraded":"2023-06-26T03:33:32.011810+0000","last_fullsized":"2023-06-26T03:33:32.011810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"32'589","reported_seq":1218,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.991465+0000","last_change":"2023-06-26T03:33:18.915860+0000","last_active":"2023-06-26T03:33:32.991465+0000","last_peered":"2023-06-26T03:33:32.991465+0000","last_clean":"2023-06-26T03:33:32.991465+0000","last_became_active":"2023-06-26T03:33:18.911049+0000","last_became_peered":"2023-06-26T03:33:18.911049+0000","last_unstale":"2023-06-26T03:33:32.991465+0000","last_undegraded":"2023-06-26T03:33:32.991465+0000","last_fullsized":"2023-06-26T03:33:32.991465+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103662794,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1010,"num_read_kb":710004,"num_write":739,"num_write_kb":217008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":58381785,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1202818473,"num_objects":399,"num_object_clones":0,"num_object_copies":1197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13047,"num_read_kb":9768504,"num_write":8659,"num_write_kb":2540642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":496250954,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7463,"ondisk_log_size":7463,"up":48,"acting":48,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":690496,"kb_used_data":641528,"kb_used_omap":0,"kb_used_meta":48960,"kb_avail":93681344,"statfs":{"total":96636764160,"available":95929696256,"internally_reserved":0,"allocated":656924672,"data_stored":653426010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50135040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":23,"seq":98784248137,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":566444,"kb_used_data":531428,"kb_used_omap":0,"kb_used_meta":35008,"kb_avail":93805396,"statfs":{"total":96636764160,"available":96056725504,"internally_reserved":0,"allocated":544182272,"data_stored":534405257,"data_compressed":29917,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35848192},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":781300,"kb_used_data":710188,"kb_used_omap":0,"kb_used_meta":71104,"kb_avail":93590540,"statfs":{"total":96636764160,"available":95836712960,"internally_reserved":0,"allocated":727232512,"data_stored":723937186,"data_compressed":29917,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72810496},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":766544,"kb_used_data":695432,"kb_used_omap":0,"kb_used_meta":71104,"kb_avail":93605296,"statfs":{"total":96636764160,"available":95851823104,"internally_reserved":0,"allocated":712122368,"data_stored":708896716,"data_compressed":29917,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72810496},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}}

2023-06-26T14:58:59.473 WARNING:scrape:Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107428.log
, gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112777.log
, /var/log/ceph/ceph-client.0.107428.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120024.log

2023-06-26T14:58:59.477 WARNING:scrape:Ignoring malparsed backtrace:  50.0% -- replaced with /var/log/ceph/ceph-client.admin.118035.log.gz
, /var/log/ceph/ceph-client.admin.106415.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114064.log
,  50.0% -- replaced with /var/log/ceph/ceph-client.admin.106415.log.gz

2023-06-26T14:58:59.478 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.105219.log:	gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log
,  49.6% -- replaced with /var/log/ceph/ceph-client.admin.105219.log.gz
, /var/log/ceph/ceph-client.admin.105267.log:	 50.0% -- replaced with /var/log/ceph/ceph-client.admin.105267.log.gz

2023-06-26T14:58:59.479 WARNING:scrape:Ignoring malparsed backtrace:  50.0% -- replaced with /var/log/ceph/ceph-client.admin.109942.log.gz
, /var/log/ceph/ceph-client.admin.109613.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117981.log
,  50.4% -- replaced with /var/log/ceph/ceph-client.admin.109613.log.gz

2023-06-26T14:58:59.480 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.110983.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119850.log
,  50.0% -- replaced with /var/log/ceph/ceph-client.admin.110983.log.gz
, /var/log/ceph/ceph-client.admin.108264.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109566.log

2023-06-26T14:58:59.481 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.119801.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118164.log
,  49.6% -- replaced with /var/log/ceph/ceph-client.admin.119801.log.gz
, /var/log/ceph/ceph-client.admin.109100.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112089.log

2023-06-26T14:58:59.482 WARNING:scrape:Ignoring malparsed backtrace:  91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz
,  91.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz
, 

2023-06-26T14:58:59.483 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T03:34:10.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive
, 2023-06-26T03:34:10.457 INFO:teuthology.task.internal:Transferring archived files...
, 2023-06-26T03:34:10.459 DEBUG:teuthology.misc:Transferring archived files from smithi061:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316146/remote/smithi061

2023-06-26T14:58:59.538 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 18.0.0-4629-g1e8a39f3 (1e8a39f359d8481bb3038b461063c87384bf3ee8) reef (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x120) [0x7f5ab3f7c7ff]
,  2: (ceph::register_assert_context(ceph::common::CephContext*)+0) [0x7f5ab3f7ca2a]

2023-06-26T14:58:59.539 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T03:33:31.145+0000 7f99d9e15700 -1 WARNING: the following dangerous and experimental features are enabled: crimson
, 2023-06-26T03:33:31.154+0000 7f99d9e15700 -1 WARNING: the following dangerous and experimental features are enabled: crimson
, set osd.3 primary-affinity to 1 (8655362)

2023-06-26T14:58:59.540 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T03:33:37.084 INFO:teuthology.orchestra.run.smithi061.stdout:
, dumped all
, 2023-06-26T03:33:37.098 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-06-26T03:33:36.128532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1203408841,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13150,"num_read_kb":9768595,"num_write":8796,"num_write_kb":2542536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":496250954,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7560,"ondisk_log_size":7560,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":2804784,"kb_used_data":2578576,"kb_used_omap":0,"kb_used_meta":226176,"kb_avail":374682576,"statfs":{"total":386547056640,"available":383674957824,"internally_reserved":0,"allocated":2640461824,"data_stored":2620665169,"data_compressed":89751,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":231604224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.135159"},"pg_stats":[{"pgid":"3.f","version":"22'474","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-26T03:33:31.157904+0000","last_change":"2023-06-26T03:33:19.881706+0000","last_active":"2023-06-26T03:33:31.157904+0000","last_peered":"2023-06-26T03:33:31.157904+0000","last_clean":"2023-06-26T03:33:31.157904+0000","last_became_active":"2023-06-26T03:33:19.878659+0000","last_became_peered":"2023-06-26T03:33:19.878659+0000","last_unstale":"2023-06-26T03:33:31.157904+0000","last_undegraded":"2023-06-26T03:33:31.157904+0000","last_fullsized":"2023-06-26T03:33:31.157904+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12827,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":52336274,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"32'432","reported_seq":884,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.965133+0000","last_change":"2023-06-26T03:33:14.046533+0000","last_active":"2023-06-26T03:33:32.965133+0000","last_peered":"2023-06-26T03:33:32.965133+0000","last_clean":"2023-06-26T03:33:32.965133+0000","last_became_active":"2023-06-26T03:33:14.038723+0000","last_became_peered":"2023-06-26T03:33:14.038723+0000","last_unstale":"2023-06-26T03:33:32.965133+0000","last_undegraded":"2023-06-26T03:33:32.965133+0000","last_fullsized":"2023-06-26T03:33:32.965133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72432385,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":654,"num_read_kb":446879,"num_write":538,"num_write_kb":157922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":48628713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"31'519","reported_seq":1068,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.020737+0000","last_change":"2023-06-26T03:28:12.935366+0000","last_active":"2023-06-26T03:33:32.020737+0000","last_peered":"2023-06-26T03:33:32.020737+0000","last_clean":"2023-06-26T03:33:32.020737+0000","last_became_active":"2023-06-26T03:28:12.932005+0000","last_became_peered":"2023-06-26T03:28:12.932005+0000","last_unstale":"2023-06-26T03:33:32.020737+0000","last_undegraded":"2023-06-26T03:33:32.020737+0000","last_fullsized":"2023-06-26T03:33:32.020737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101294360,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1025,"num_read_kb":749085,"num_write":655,"num_write_kb":190173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"25'511","reported_seq":1025,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.021337+0000","last_change":"2023-06-26T03:28:12.935230+0000","last_active":"2023-06-26T03:33:32.021337+0000","last_peered":"2023-06-26T03:33:32.021337+0000","last_clean":"2023-06-26T03:33:32.021337+0000","last_became_active":"2023-06-26T03:28:12.932318+0000","last_became_peered":"2023-06-26T03:28:12.932318+0000","last_unstale":"2023-06-26T03:33:32.021337+0000","last_undegraded":"2023-06-26T03:33:32.021337+0000","last_fullsized":"2023-06-26T03:33:32.021337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91308065,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":956,"num_read_kb":716586,"num_write":640,"num_write_kb":190106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'427","reported_seq":908,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.971256+0000","last_change":"2023-06-26T03:28:12.971493+0000","last_active":"2023-06-26T03:33:32.971256+0000","last_peered":"2023-06-26T03:33:32.971256+0000","last_clean":"2023-06-26T03:33:32.971256+0000","last_became_active":"2023-06-26T03:28:12.968594+0000","last_became_peered":"2023-06-26T03:28:12.968594+0000","last_unstale":"2023-06-26T03:33:32.971256+0000","last_undegraded":"2023-06-26T03:33:32.971256+0000","last_fullsized":"2023-06-26T03:33:32.971256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79811021,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":879,"num_read_kb":643829,"num_write":538,"num_write_kb":157649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'446","reported_seq":962,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.013982+0000","last_change":"2023-06-26T03:33:11.024784+0000","last_active":"2023-06-26T03:33:32.013982+0000","last_peered":"2023-06-26T03:33:32.013982+0000","last_clean":"2023-06-26T03:33:32.013982+0000","last_became_active":"2023-06-26T03:33:11.021791+0000","last_became_peered":"2023-06-26T03:33:11.021791+0000","last_unstale":"2023-06-26T03:33:32.013982+0000","last_undegraded":"2023-06-26T03:33:32.013982+0000","last_fullsized":"2023-06-26T03:33:32.013982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83928274,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":600578,"num_write":555,"num_write_kb":161312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":51237268,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"28'474","reported_seq":1029,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.024984+0000","last_change":"2023-06-26T03:33:11.019328+0000","last_active":"2023-06-26T03:33:32.024984+0000","last_peered":"2023-06-26T03:33:32.024984+0000","last_clean":"2023-06-26T03:33:32.024984+0000","last_became_active":"2023-06-26T03:33:11.015940+0000","last_became_peered":"2023-06-26T03:33:11.015940+0000","last_unstale":"2023-06-26T03:33:32.024984+0000","last_undegraded":"2023-06-26T03:33:32.024984+0000","last_fullsized":"2023-06-26T03:33:32.024984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85173510,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":867,"num_read_kb":640592,"num_write":603,"num_write_kb":177355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":54241940,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"29'408","reported_seq":851,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.020899+0000","last_change":"2023-06-26T03:28:12.988945+0000","last_active":"2023-06-26T03:33:32.020899+0000","last_peered":"2023-06-26T03:33:32.020899+0000","last_clean":"2023-06-26T03:33:32.020899+0000","last_became_active":"2023-06-26T03:28:12.977936+0000","last_became_peered":"2023-06-26T03:28:12.977936+0000","last_unstale":"2023-06-26T03:33:32.020899+0000","last_undegraded":"2023-06-26T03:33:32.020899+0000","last_fullsized":"2023-06-26T03:33:32.020899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72735505,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":793,"num_read_kb":641636,"num_write":511,"num_write_kb":150735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.981112+0000","last_change":"2023-06-26T03:33:04.032677+0000","last_active":"2023-06-26T03:33:32.981112+0000","last_peered":"2023-06-26T03:33:32.981112+0000","last_clean":"2023-06-26T03:33:32.981112+0000","last_became_active":"2023-06-26T03:33:04.021706+0000","last_became_peered":"2023-06-26T03:33:04.021706+0000","last_unstale":"2023-06-26T03:33:32.981112+0000","last_undegraded":"2023-06-26T03:33:32.981112+0000","last_fullsized":"2023-06-26T03:33:32.981112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'444","reported_seq":788,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-26T03:33:31.152204+0000","last_change":"2023-06-26T03:33:11.003758+0000","last_active":"2023-06-26T03:33:31.152204+0000","last_peered":"2023-06-26T03:33:31.152204+0000","last_clean":"2023-06-26T03:33:31.152204+0000","last_became_active":"2023-06-26T03:33:11.000588+0000","last_became_peered":"2023-06-26T03:33:11.000588+0000","last_unstale":"2023-06-26T03:33:31.152204+0000","last_undegraded":"2023-06-26T03:33:31.152204+0000","last_fullsized":"2023-06-26T03:33:31.152204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4153243,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":661489,"num_write":438,"num_write_kb":127217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":47436104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.023927+0000","last_change":"2023-06-26T03:33:04.005514+0000","last_active":"2023-06-26T03:33:32.023927+0000","last_peered":"2023-06-26T03:33:32.023927+0000","last_clean":"2023-06-26T03:33:32.023927+0000","last_became_active":"2023-06-26T03:33:03.995911+0000","last_became_peered":"2023-06-26T03:33:03.995911+0000","last_unstale":"2023-06-26T03:33:32.023927+0000","last_undegraded":"2023-06-26T03:33:32.023927+0000","last_fullsized":"2023-06-26T03:33:32.023927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'415","reported_seq":927,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.991289+0000","last_change":"2023-06-26T03:33:16.028748+0000","last_active":"2023-06-26T03:33:32.991289+0000","last_peered":"2023-06-26T03:33:32.991289+0000","last_clean":"2023-06-26T03:33:32.991289+0000","last_became_active":"2023-06-26T03:33:16.024169+0000","last_became_peered":"2023-06-26T03:33:16.024169+0000","last_unstale":"2023-06-26T03:33:32.991289+0000","last_undegraded":"2023-06-26T03:33:32.991289+0000","last_fullsized":"2023-06-26T03:33:32.991289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74465570,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":646413,"num_write":517,"num_write_kb":153491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":43055054,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":68,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-26T03:33:31.146923+0000","last_change":"2023-06-26T03:33:03.971932+0000","last_active":"2023-06-26T03:33:31.146923+0000","last_peered":"2023-06-26T03:33:31.146923+0000","last_clean":"2023-06-26T03:33:31.146923+0000","last_became_active":"2023-06-26T03:33:03.962368+0000","last_became_peered":"2023-06-26T03:33:03.962368+0000","last_unstale":"2023-06-26T03:33:31.146923+0000","last_undegraded":"2023-06-26T03:33:31.146923+0000","last_fullsized":"2023-06-26T03:33:31.146923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'467","reported_seq":1001,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.966109+0000","last_change":"2023-06-26T03:33:14.037875+0000","last_active":"2023-06-26T03:33:32.966109+0000","last_peered":"2023-06-26T03:33:32.966109+0000","last_clean":"2023-06-26T03:33:32.966109+0000","last_became_active":"2023-06-26T03:33:14.032805+0000","last_became_peered":"2023-06-26T03:33:14.032805+0000","last_unstale":"2023-06-26T03:33:32.966109+0000","last_undegraded":"2023-06-26T03:33:32.966109+0000","last_fullsized":"2023-06-26T03:33:32.966109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87241101,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":829,"num_read_kb":655593,"num_write":593,"num_write_kb":176603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":51495841,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.007855+0000","last_change":"2023-06-26T03:33:03.975638+0000","last_active":"2023-06-26T03:33:32.007855+0000","last_peered":"2023-06-26T03:33:32.007855+0000","last_clean":"2023-06-26T03:33:32.007855+0000","last_became_active":"2023-06-26T03:33:03.972496+0000","last_became_peered":"2023-06-26T03:33:03.972496+0000","last_unstale":"2023-06-26T03:33:32.007855+0000","last_undegraded":"2023-06-26T03:33:32.007855+0000","last_fullsized":"2023-06-26T03:33:32.007855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":207,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.969923+0000","last_change":"2023-06-26T03:33:04.001440+0000","last_active":"2023-06-26T03:33:32.969923+0000","last_peered":"2023-06-26T03:33:32.969923+0000","last_clean":"2023-06-26T03:33:32.969923+0000","last_became_active":"2023-06-26T03:33:03.994797+0000","last_became_peered":"2023-06-26T03:33:03.994797+0000","last_unstale":"2023-06-26T03:33:32.969923+0000","last_undegraded":"2023-06-26T03:33:32.969923+0000","last_fullsized":"2023-06-26T03:33:32.969923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'349","reported_seq":780,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.008730+0000","last_change":"2023-06-26T03:33:13.016200+0000","last_active":"2023-06-26T03:33:32.008730+0000","last_peered":"2023-06-26T03:33:32.008730+0000","last_clean":"2023-06-26T03:33:32.008730+0000","last_became_active":"2023-06-26T03:33:13.013216+0000","last_became_peered":"2023-06-26T03:33:13.013216+0000","last_unstale":"2023-06-26T03:33:32.008730+0000","last_undegraded":"2023-06-26T03:33:32.008730+0000","last_fullsized":"2023-06-26T03:33:32.008730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59118799,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":657,"num_read_kb":512776,"num_write":443,"num_write_kb":129765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":37455466,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.023296+0000","last_change":"2023-06-26T03:33:03.965798+0000","last_active":"2023-06-26T03:33:32.023296+0000","last_peered":"2023-06-26T03:33:32.023296+0000","last_clean":"2023-06-26T03:33:32.023296+0000","last_became_active":"2023-06-26T03:33:03.956975+0000","last_became_peered":"2023-06-26T03:33:03.956975+0000","last_unstale":"2023-06-26T03:33:32.023296+0000","last_undegraded":"2023-06-26T03:33:32.023296+0000","last_fullsized":"2023-06-26T03:33:32.023296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'499","reported_seq":1073,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.989923+0000","last_change":"2023-06-26T03:33:18.067146+0000","last_active":"2023-06-26T03:33:32.989923+0000","last_peered":"2023-06-26T03:33:32.989923+0000","last_clean":"2023-06-26T03:33:32.989923+0000","last_became_active":"2023-06-26T03:33:18.060805+0000","last_became_peered":"2023-06-26T03:33:18.060805+0000","last_unstale":"2023-06-26T03:33:32.989923+0000","last_undegraded":"2023-06-26T03:33:32.989923+0000","last_fullsized":"2023-06-26T03:33:32.989923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98419274,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":919,"num_read_kb":664725,"num_write":629,"num_write_kb":185815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":51982509,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.972318+0000","last_change":"2023-06-26T03:33:03.975155+0000","last_active":"2023-06-26T03:33:32.972318+0000","last_peered":"2023-06-26T03:33:32.972318+0000","last_clean":"2023-06-26T03:33:32.972318+0000","last_became_active":"2023-06-26T03:33:03.966827+0000","last_became_peered":"2023-06-26T03:33:03.966827+0000","last_unstale":"2023-06-26T03:33:32.972318+0000","last_undegraded":"2023-06-26T03:33:32.972318+0000","last_fullsized":"2023-06-26T03:33:32.972318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'667","reported_seq":1350,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.965272+0000","last_change":"2023-06-26T03:28:12.995749+0000","last_active":"2023-06-26T03:33:32.965272+0000","last_peered":"2023-06-26T03:33:32.965272+0000","last_clean":"2023-06-26T03:33:32.965272+0000","last_became_active":"2023-06-26T03:28:12.992276+0000","last_became_peered":"2023-06-26T03:28:12.992276+0000","last_unstale":"2023-06-26T03:33:32.965272+0000","last_undegraded":"2023-06-26T03:33:32.965272+0000","last_fullsized":"2023-06-26T03:33:32.965272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124811775,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1313,"num_read_kb":983801,"num_write":839,"num_write_kb":243360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'342","reported_seq":724,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.975612+0000","last_change":"2023-06-26T03:28:12.985762+0000","last_active":"2023-06-26T03:33:32.975612+0000","last_peered":"2023-06-26T03:33:32.975612+0000","last_clean":"2023-06-26T03:33:32.975612+0000","last_became_active":"2023-06-26T03:28:12.976594+0000","last_became_peered":"2023-06-26T03:28:12.976594+0000","last_unstale":"2023-06-26T03:33:32.975612+0000","last_undegraded":"2023-06-26T03:33:32.975612+0000","last_fullsized":"2023-06-26T03:33:32.975612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64262797,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":688,"num_read_kb":481691,"num_write":421,"num_write_kb":122131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.970968+0000","last_change":"2023-06-26T03:33:03.991445+0000","last_active":"2023-06-26T03:33:32.970968+0000","last_peered":"2023-06-26T03:33:32.970968+0000","last_clean":"2023-06-26T03:33:32.970968+0000","last_became_active":"2023-06-26T03:33:03.988463+0000","last_became_peered":"2023-06-26T03:33:03.988463+0000","last_unstale":"2023-06-26T03:33:32.970968+0000","last_undegraded":"2023-06-26T03:33:32.970968+0000","last_fullsized":"2023-06-26T03:33:32.970968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.011810+0000","last_change":"2023-06-26T03:33:03.975627+0000","last_active":"2023-06-26T03:33:32.011810+0000","last_peered":"2023-06-26T03:33:32.011810+0000","last_clean":"2023-06-26T03:33:32.011810+0000","last_became_active":"2023-06-26T03:33:03.972087+0000","last_became_peered":"2023-06-26T03:33:03.972087+0000","last_unstale":"2023-06-26T03:33:32.011810+0000","last_undegraded":"2023-06-26T03:33:32.011810+0000","last_fullsized":"2023-06-26T03:33:32.011810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"32'589","reported_seq":1218,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.991465+0000","last_change":"2023-06-26T03:33:18.915860+0000","last_active":"2023-06-26T03:33:32.991465+0000","last_peered":"2023-06-26T03:33:32.991465+0000","last_clean":"2023-06-26T03:33:32.991465+0000","last_became_active":"2023-06-26T03:33:18.911049+0000","last_became_peered":"2023-06-26T03:33:18.911049+0000","last_unstale":"2023-06-26T03:33:32.991465+0000","last_undegraded":"2023-06-26T03:33:32.991465+0000","last_fullsized":"2023-06-26T03:33:32.991465+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103662794,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1010,"num_read_kb":710004,"num_write":739,"num_write_kb":217008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":58381785,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1202818473,"num_objects":399,"num_object_clones":0,"num_object_copies":1197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13047,"num_read_kb":9768504,"num_write":8659,"num_write_kb":2540642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":496250954,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7463,"ondisk_log_size":7463,"up":48,"acting":48,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":690496,"kb_used_data":641528,"kb_used_omap":0,"kb_used_meta":48960,"kb_avail":93681344,"statfs":{"total":96636764160,"available":95929696256,"internally_reserved":0,"allocated":656924672,"data_stored":653426010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50135040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":23,"seq":98784248137,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":566444,"kb_used_data":531428,"kb_used_omap":0,"kb_used_meta":35008,"kb_avail":93805396,"statfs":{"total":96636764160,"available":96056725504,"internally_reserved":0,"allocated":544182272,"data_stored":534405257,"data_compressed":29917,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35848192},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":781300,"kb_used_data":710188,"kb_used_omap":0,"kb_used_meta":71104,"kb_avail":93590540,"statfs":{"total":96636764160,"available":95836712960,"internally_reserved":0,"allocated":727232512,"data_stored":723937186,"data_compressed":29917,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72810496},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":766544,"kb_used_data":695432,"kb_used_omap":0,"kb_used_meta":71104,"kb_avail":93605296,"statfs":{"total":96636764160,"available":95851823104,"internally_reserved":0,"allocated":712122368,"data_stored":708896716,"data_compressed":29917,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72810496},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}}

2023-06-26T14:58:59.542 WARNING:scrape:Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107428.log
, gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112777.log
, /var/log/ceph/ceph-client.0.107428.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120024.log

2023-06-26T14:58:59.542 WARNING:scrape:Ignoring malparsed backtrace:  50.0% -- replaced with /var/log/ceph/ceph-client.admin.118035.log.gz
, /var/log/ceph/ceph-client.admin.106415.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114064.log
,  50.0% -- replaced with /var/log/ceph/ceph-client.admin.106415.log.gz

2023-06-26T14:58:59.543 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.105219.log:	gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log
,  49.6% -- replaced with /var/log/ceph/ceph-client.admin.105219.log.gz
, /var/log/ceph/ceph-client.admin.105267.log:	 50.0% -- replaced with /var/log/ceph/ceph-client.admin.105267.log.gz

2023-06-26T14:58:59.544 WARNING:scrape:Ignoring malparsed backtrace:  50.0% -- replaced with /var/log/ceph/ceph-client.admin.109942.log.gz
, /var/log/ceph/ceph-client.admin.109613.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117981.log
,  50.4% -- replaced with /var/log/ceph/ceph-client.admin.109613.log.gz

2023-06-26T14:58:59.544 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.110983.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119850.log
,  50.0% -- replaced with /var/log/ceph/ceph-client.admin.110983.log.gz
, /var/log/ceph/ceph-client.admin.108264.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109566.log

2023-06-26T14:58:59.545 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.119801.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118164.log
,  49.6% -- replaced with /var/log/ceph/ceph-client.admin.119801.log.gz
, /var/log/ceph/ceph-client.admin.109100.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112089.log

2023-06-26T14:58:59.545 WARNING:scrape:Ignoring malparsed backtrace:  91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz
,  91.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz
, 

2023-06-26T14:58:59.546 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T03:34:10.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive
, 2023-06-26T03:34:10.457 INFO:teuthology.task.internal:Transferring archived files...
, 2023-06-26T03:34:10.459 DEBUG:teuthology.misc:Transferring archived files from smithi061:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316146/remote/smithi061

2023-06-26T14:58:59.615 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 18.0.0-4629-g1e8a39f3 (1e8a39f359d8481bb3038b461063c87384bf3ee8) reef (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x120) [0x7f5ab3f7c7ff]
,  2: (ceph::register_assert_context(ceph::common::CephContext*)+0) [0x7f5ab3f7ca2a]

2023-06-26T14:58:59.617 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T03:33:31.145+0000 7f99d9e15700 -1 WARNING: the following dangerous and experimental features are enabled: crimson
, 2023-06-26T03:33:31.154+0000 7f99d9e15700 -1 WARNING: the following dangerous and experimental features are enabled: crimson
, set osd.3 primary-affinity to 1 (8655362)

2023-06-26T14:58:59.619 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T03:33:37.084 INFO:teuthology.orchestra.run.smithi061.stdout:
, dumped all
, 2023-06-26T03:33:37.098 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-06-26T03:33:36.128532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1203408841,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13150,"num_read_kb":9768595,"num_write":8796,"num_write_kb":2542536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":496250954,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7560,"ondisk_log_size":7560,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":2804784,"kb_used_data":2578576,"kb_used_omap":0,"kb_used_meta":226176,"kb_avail":374682576,"statfs":{"total":386547056640,"available":383674957824,"internally_reserved":0,"allocated":2640461824,"data_stored":2620665169,"data_compressed":89751,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":231604224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.135159"},"pg_stats":[{"pgid":"3.f","version":"22'474","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-26T03:33:31.157904+0000","last_change":"2023-06-26T03:33:19.881706+0000","last_active":"2023-06-26T03:33:31.157904+0000","last_peered":"2023-06-26T03:33:31.157904+0000","last_clean":"2023-06-26T03:33:31.157904+0000","last_became_active":"2023-06-26T03:33:19.878659+0000","last_became_peered":"2023-06-26T03:33:19.878659+0000","last_unstale":"2023-06-26T03:33:31.157904+0000","last_undegraded":"2023-06-26T03:33:31.157904+0000","last_fullsized":"2023-06-26T03:33:31.157904+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12827,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":52336274,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"32'432","reported_seq":884,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.965133+0000","last_change":"2023-06-26T03:33:14.046533+0000","last_active":"2023-06-26T03:33:32.965133+0000","last_peered":"2023-06-26T03:33:32.965133+0000","last_clean":"2023-06-26T03:33:32.965133+0000","last_became_active":"2023-06-26T03:33:14.038723+0000","last_became_peered":"2023-06-26T03:33:14.038723+0000","last_unstale":"2023-06-26T03:33:32.965133+0000","last_undegraded":"2023-06-26T03:33:32.965133+0000","last_fullsized":"2023-06-26T03:33:32.965133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72432385,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":654,"num_read_kb":446879,"num_write":538,"num_write_kb":157922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":48628713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"31'519","reported_seq":1068,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.020737+0000","last_change":"2023-06-26T03:28:12.935366+0000","last_active":"2023-06-26T03:33:32.020737+0000","last_peered":"2023-06-26T03:33:32.020737+0000","last_clean":"2023-06-26T03:33:32.020737+0000","last_became_active":"2023-06-26T03:28:12.932005+0000","last_became_peered":"2023-06-26T03:28:12.932005+0000","last_unstale":"2023-06-26T03:33:32.020737+0000","last_undegraded":"2023-06-26T03:33:32.020737+0000","last_fullsized":"2023-06-26T03:33:32.020737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101294360,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1025,"num_read_kb":749085,"num_write":655,"num_write_kb":190173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"25'511","reported_seq":1025,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.021337+0000","last_change":"2023-06-26T03:28:12.935230+0000","last_active":"2023-06-26T03:33:32.021337+0000","last_peered":"2023-06-26T03:33:32.021337+0000","last_clean":"2023-06-26T03:33:32.021337+0000","last_became_active":"2023-06-26T03:28:12.932318+0000","last_became_peered":"2023-06-26T03:28:12.932318+0000","last_unstale":"2023-06-26T03:33:32.021337+0000","last_undegraded":"2023-06-26T03:33:32.021337+0000","last_fullsized":"2023-06-26T03:33:32.021337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91308065,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":956,"num_read_kb":716586,"num_write":640,"num_write_kb":190106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'427","reported_seq":908,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.971256+0000","last_change":"2023-06-26T03:28:12.971493+0000","last_active":"2023-06-26T03:33:32.971256+0000","last_peered":"2023-06-26T03:33:32.971256+0000","last_clean":"2023-06-26T03:33:32.971256+0000","last_became_active":"2023-06-26T03:28:12.968594+0000","last_became_peered":"2023-06-26T03:28:12.968594+0000","last_unstale":"2023-06-26T03:33:32.971256+0000","last_undegraded":"2023-06-26T03:33:32.971256+0000","last_fullsized":"2023-06-26T03:33:32.971256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79811021,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":879,"num_read_kb":643829,"num_write":538,"num_write_kb":157649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'446","reported_seq":962,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.013982+0000","last_change":"2023-06-26T03:33:11.024784+0000","last_active":"2023-06-26T03:33:32.013982+0000","last_peered":"2023-06-26T03:33:32.013982+0000","last_clean":"2023-06-26T03:33:32.013982+0000","last_became_active":"2023-06-26T03:33:11.021791+0000","last_became_peered":"2023-06-26T03:33:11.021791+0000","last_unstale":"2023-06-26T03:33:32.013982+0000","last_undegraded":"2023-06-26T03:33:32.013982+0000","last_fullsized":"2023-06-26T03:33:32.013982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83928274,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":600578,"num_write":555,"num_write_kb":161312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":51237268,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"28'474","reported_seq":1029,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.024984+0000","last_change":"2023-06-26T03:33:11.019328+0000","last_active":"2023-06-26T03:33:32.024984+0000","last_peered":"2023-06-26T03:33:32.024984+0000","last_clean":"2023-06-26T03:33:32.024984+0000","last_became_active":"2023-06-26T03:33:11.015940+0000","last_became_peered":"2023-06-26T03:33:11.015940+0000","last_unstale":"2023-06-26T03:33:32.024984+0000","last_undegraded":"2023-06-26T03:33:32.024984+0000","last_fullsized":"2023-06-26T03:33:32.024984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85173510,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":867,"num_read_kb":640592,"num_write":603,"num_write_kb":177355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":54241940,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"29'408","reported_seq":851,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.020899+0000","last_change":"2023-06-26T03:28:12.988945+0000","last_active":"2023-06-26T03:33:32.020899+0000","last_peered":"2023-06-26T03:33:32.020899+0000","last_clean":"2023-06-26T03:33:32.020899+0000","last_became_active":"2023-06-26T03:28:12.977936+0000","last_became_peered":"2023-06-26T03:28:12.977936+0000","last_unstale":"2023-06-26T03:33:32.020899+0000","last_undegraded":"2023-06-26T03:33:32.020899+0000","last_fullsized":"2023-06-26T03:33:32.020899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72735505,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":793,"num_read_kb":641636,"num_write":511,"num_write_kb":150735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.981112+0000","last_change":"2023-06-26T03:33:04.032677+0000","last_active":"2023-06-26T03:33:32.981112+0000","last_peered":"2023-06-26T03:33:32.981112+0000","last_clean":"2023-06-26T03:33:32.981112+0000","last_became_active":"2023-06-26T03:33:04.021706+0000","last_became_peered":"2023-06-26T03:33:04.021706+0000","last_unstale":"2023-06-26T03:33:32.981112+0000","last_undegraded":"2023-06-26T03:33:32.981112+0000","last_fullsized":"2023-06-26T03:33:32.981112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'444","reported_seq":788,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-26T03:33:31.152204+0000","last_change":"2023-06-26T03:33:11.003758+0000","last_active":"2023-06-26T03:33:31.152204+0000","last_peered":"2023-06-26T03:33:31.152204+0000","last_clean":"2023-06-26T03:33:31.152204+0000","last_became_active":"2023-06-26T03:33:11.000588+0000","last_became_peered":"2023-06-26T03:33:11.000588+0000","last_unstale":"2023-06-26T03:33:31.152204+0000","last_undegraded":"2023-06-26T03:33:31.152204+0000","last_fullsized":"2023-06-26T03:33:31.152204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4153243,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":661489,"num_write":438,"num_write_kb":127217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":47436104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.023927+0000","last_change":"2023-06-26T03:33:04.005514+0000","last_active":"2023-06-26T03:33:32.023927+0000","last_peered":"2023-06-26T03:33:32.023927+0000","last_clean":"2023-06-26T03:33:32.023927+0000","last_became_active":"2023-06-26T03:33:03.995911+0000","last_became_peered":"2023-06-26T03:33:03.995911+0000","last_unstale":"2023-06-26T03:33:32.023927+0000","last_undegraded":"2023-06-26T03:33:32.023927+0000","last_fullsized":"2023-06-26T03:33:32.023927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'415","reported_seq":927,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.991289+0000","last_change":"2023-06-26T03:33:16.028748+0000","last_active":"2023-06-26T03:33:32.991289+0000","last_peered":"2023-06-26T03:33:32.991289+0000","last_clean":"2023-06-26T03:33:32.991289+0000","last_became_active":"2023-06-26T03:33:16.024169+0000","last_became_peered":"2023-06-26T03:33:16.024169+0000","last_unstale":"2023-06-26T03:33:32.991289+0000","last_undegraded":"2023-06-26T03:33:32.991289+0000","last_fullsized":"2023-06-26T03:33:32.991289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74465570,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":646413,"num_write":517,"num_write_kb":153491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":43055054,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":68,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-26T03:33:31.146923+0000","last_change":"2023-06-26T03:33:03.971932+0000","last_active":"2023-06-26T03:33:31.146923+0000","last_peered":"2023-06-26T03:33:31.146923+0000","last_clean":"2023-06-26T03:33:31.146923+0000","last_became_active":"2023-06-26T03:33:03.962368+0000","last_became_peered":"2023-06-26T03:33:03.962368+0000","last_unstale":"2023-06-26T03:33:31.146923+0000","last_undegraded":"2023-06-26T03:33:31.146923+0000","last_fullsized":"2023-06-26T03:33:31.146923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'467","reported_seq":1001,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.966109+0000","last_change":"2023-06-26T03:33:14.037875+0000","last_active":"2023-06-26T03:33:32.966109+0000","last_peered":"2023-06-26T03:33:32.966109+0000","last_clean":"2023-06-26T03:33:32.966109+0000","last_became_active":"2023-06-26T03:33:14.032805+0000","last_became_peered":"2023-06-26T03:33:14.032805+0000","last_unstale":"2023-06-26T03:33:32.966109+0000","last_undegraded":"2023-06-26T03:33:32.966109+0000","last_fullsized":"2023-06-26T03:33:32.966109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87241101,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":829,"num_read_kb":655593,"num_write":593,"num_write_kb":176603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":51495841,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.007855+0000","last_change":"2023-06-26T03:33:03.975638+0000","last_active":"2023-06-26T03:33:32.007855+0000","last_peered":"2023-06-26T03:33:32.007855+0000","last_clean":"2023-06-26T03:33:32.007855+0000","last_became_active":"2023-06-26T03:33:03.972496+0000","last_became_peered":"2023-06-26T03:33:03.972496+0000","last_unstale":"2023-06-26T03:33:32.007855+0000","last_undegraded":"2023-06-26T03:33:32.007855+0000","last_fullsized":"2023-06-26T03:33:32.007855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":207,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.969923+0000","last_change":"2023-06-26T03:33:04.001440+0000","last_active":"2023-06-26T03:33:32.969923+0000","last_peered":"2023-06-26T03:33:32.969923+0000","last_clean":"2023-06-26T03:33:32.969923+0000","last_became_active":"2023-06-26T03:33:03.994797+0000","last_became_peered":"2023-06-26T03:33:03.994797+0000","last_unstale":"2023-06-26T03:33:32.969923+0000","last_undegraded":"2023-06-26T03:33:32.969923+0000","last_fullsized":"2023-06-26T03:33:32.969923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'349","reported_seq":780,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.008730+0000","last_change":"2023-06-26T03:33:13.016200+0000","last_active":"2023-06-26T03:33:32.008730+0000","last_peered":"2023-06-26T03:33:32.008730+0000","last_clean":"2023-06-26T03:33:32.008730+0000","last_became_active":"2023-06-26T03:33:13.013216+0000","last_became_peered":"2023-06-26T03:33:13.013216+0000","last_unstale":"2023-06-26T03:33:32.008730+0000","last_undegraded":"2023-06-26T03:33:32.008730+0000","last_fullsized":"2023-06-26T03:33:32.008730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59118799,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":657,"num_read_kb":512776,"num_write":443,"num_write_kb":129765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":37455466,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.023296+0000","last_change":"2023-06-26T03:33:03.965798+0000","last_active":"2023-06-26T03:33:32.023296+0000","last_peered":"2023-06-26T03:33:32.023296+0000","last_clean":"2023-06-26T03:33:32.023296+0000","last_became_active":"2023-06-26T03:33:03.956975+0000","last_became_peered":"2023-06-26T03:33:03.956975+0000","last_unstale":"2023-06-26T03:33:32.023296+0000","last_undegraded":"2023-06-26T03:33:32.023296+0000","last_fullsized":"2023-06-26T03:33:32.023296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'499","reported_seq":1073,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.989923+0000","last_change":"2023-06-26T03:33:18.067146+0000","last_active":"2023-06-26T03:33:32.989923+0000","last_peered":"2023-06-26T03:33:32.989923+0000","last_clean":"2023-06-26T03:33:32.989923+0000","last_became_active":"2023-06-26T03:33:18.060805+0000","last_became_peered":"2023-06-26T03:33:18.060805+0000","last_unstale":"2023-06-26T03:33:32.989923+0000","last_undegraded":"2023-06-26T03:33:32.989923+0000","last_fullsized":"2023-06-26T03:33:32.989923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98419274,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":919,"num_read_kb":664725,"num_write":629,"num_write_kb":185815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":51982509,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.972318+0000","last_change":"2023-06-26T03:33:03.975155+0000","last_active":"2023-06-26T03:33:32.972318+0000","last_peered":"2023-06-26T03:33:32.972318+0000","last_clean":"2023-06-26T03:33:32.972318+0000","last_became_active":"2023-06-26T03:33:03.966827+0000","last_became_peered":"2023-06-26T03:33:03.966827+0000","last_unstale":"2023-06-26T03:33:32.972318+0000","last_undegraded":"2023-06-26T03:33:32.972318+0000","last_fullsized":"2023-06-26T03:33:32.972318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'667","reported_seq":1350,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.965272+0000","last_change":"2023-06-26T03:28:12.995749+0000","last_active":"2023-06-26T03:33:32.965272+0000","last_peered":"2023-06-26T03:33:32.965272+0000","last_clean":"2023-06-26T03:33:32.965272+0000","last_became_active":"2023-06-26T03:28:12.992276+0000","last_became_peered":"2023-06-26T03:28:12.992276+0000","last_unstale":"2023-06-26T03:33:32.965272+0000","last_undegraded":"2023-06-26T03:33:32.965272+0000","last_fullsized":"2023-06-26T03:33:32.965272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124811775,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1313,"num_read_kb":983801,"num_write":839,"num_write_kb":243360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'342","reported_seq":724,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.975612+0000","last_change":"2023-06-26T03:28:12.985762+0000","last_active":"2023-06-26T03:33:32.975612+0000","last_peered":"2023-06-26T03:33:32.975612+0000","last_clean":"2023-06-26T03:33:32.975612+0000","last_became_active":"2023-06-26T03:28:12.976594+0000","last_became_peered":"2023-06-26T03:28:12.976594+0000","last_unstale":"2023-06-26T03:33:32.975612+0000","last_undegraded":"2023-06-26T03:33:32.975612+0000","last_fullsized":"2023-06-26T03:33:32.975612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64262797,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":688,"num_read_kb":481691,"num_write":421,"num_write_kb":122131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.970968+0000","last_change":"2023-06-26T03:33:03.991445+0000","last_active":"2023-06-26T03:33:32.970968+0000","last_peered":"2023-06-26T03:33:32.970968+0000","last_clean":"2023-06-26T03:33:32.970968+0000","last_became_active":"2023-06-26T03:33:03.988463+0000","last_became_peered":"2023-06-26T03:33:03.988463+0000","last_unstale":"2023-06-26T03:33:32.970968+0000","last_undegraded":"2023-06-26T03:33:32.970968+0000","last_fullsized":"2023-06-26T03:33:32.970968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.011810+0000","last_change":"2023-06-26T03:33:03.975627+0000","last_active":"2023-06-26T03:33:32.011810+0000","last_peered":"2023-06-26T03:33:32.011810+0000","last_clean":"2023-06-26T03:33:32.011810+0000","last_became_active":"2023-06-26T03:33:03.972087+0000","last_became_peered":"2023-06-26T03:33:03.972087+0000","last_unstale":"2023-06-26T03:33:32.011810+0000","last_undegraded":"2023-06-26T03:33:32.011810+0000","last_fullsized":"2023-06-26T03:33:32.011810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"32'589","reported_seq":1218,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.991465+0000","last_change":"2023-06-26T03:33:18.915860+0000","last_active":"2023-06-26T03:33:32.991465+0000","last_peered":"2023-06-26T03:33:32.991465+0000","last_clean":"2023-06-26T03:33:32.991465+0000","last_became_active":"2023-06-26T03:33:18.911049+0000","last_became_peered":"2023-06-26T03:33:18.911049+0000","last_unstale":"2023-06-26T03:33:32.991465+0000","last_undegraded":"2023-06-26T03:33:32.991465+0000","last_fullsized":"2023-06-26T03:33:32.991465+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103662794,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1010,"num_read_kb":710004,"num_write":739,"num_write_kb":217008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":58381785,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1202818473,"num_objects":399,"num_object_clones":0,"num_object_copies":1197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13047,"num_read_kb":9768504,"num_write":8659,"num_write_kb":2540642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":496250954,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7463,"ondisk_log_size":7463,"up":48,"acting":48,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":690496,"kb_used_data":641528,"kb_used_omap":0,"kb_used_meta":48960,"kb_avail":93681344,"statfs":{"total":96636764160,"available":95929696256,"internally_reserved":0,"allocated":656924672,"data_stored":653426010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50135040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":23,"seq":98784248137,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":566444,"kb_used_data":531428,"kb_used_omap":0,"kb_used_meta":35008,"kb_avail":93805396,"statfs":{"total":96636764160,"available":96056725504,"internally_reserved":0,"allocated":544182272,"data_stored":534405257,"data_compressed":29917,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35848192},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":781300,"kb_used_data":710188,"kb_used_omap":0,"kb_used_meta":71104,"kb_avail":93590540,"statfs":{"total":96636764160,"available":95836712960,"internally_reserved":0,"allocated":727232512,"data_stored":723937186,"data_compressed":29917,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72810496},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":766544,"kb_used_data":695432,"kb_used_omap":0,"kb_used_meta":71104,"kb_avail":93605296,"statfs":{"total":96636764160,"available":95851823104,"internally_reserved":0,"allocated":712122368,"data_stored":708896716,"data_compressed":29917,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72810496},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}}

2023-06-26T14:58:59.622 WARNING:scrape:Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107428.log
, gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112777.log
, /var/log/ceph/ceph-client.0.107428.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120024.log

2023-06-26T14:58:59.623 WARNING:scrape:Ignoring malparsed backtrace:  50.0% -- replaced with /var/log/ceph/ceph-client.admin.118035.log.gz
, /var/log/ceph/ceph-client.admin.106415.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114064.log
,  50.0% -- replaced with /var/log/ceph/ceph-client.admin.106415.log.gz

2023-06-26T14:58:59.624 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.105219.log:	gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log
,  49.6% -- replaced with /var/log/ceph/ceph-client.admin.105219.log.gz
, /var/log/ceph/ceph-client.admin.105267.log:	 50.0% -- replaced with /var/log/ceph/ceph-client.admin.105267.log.gz

2023-06-26T14:58:59.624 WARNING:scrape:Ignoring malparsed backtrace:  50.0% -- replaced with /var/log/ceph/ceph-client.admin.109942.log.gz
, /var/log/ceph/ceph-client.admin.109613.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117981.log
,  50.4% -- replaced with /var/log/ceph/ceph-client.admin.109613.log.gz

2023-06-26T14:58:59.625 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.110983.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119850.log
,  50.0% -- replaced with /var/log/ceph/ceph-client.admin.110983.log.gz
, /var/log/ceph/ceph-client.admin.108264.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109566.log

2023-06-26T14:58:59.626 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.119801.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118164.log
,  49.6% -- replaced with /var/log/ceph/ceph-client.admin.119801.log.gz
, /var/log/ceph/ceph-client.admin.109100.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112089.log

2023-06-26T14:58:59.626 WARNING:scrape:Ignoring malparsed backtrace:  91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz
,  91.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz
, 

2023-06-26T14:58:59.627 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T03:34:10.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive
, 2023-06-26T03:34:10.457 INFO:teuthology.task.internal:Transferring archived files...
, 2023-06-26T03:34:10.459 DEBUG:teuthology.misc:Transferring archived files from smithi061:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316146/remote/smithi061

2023-06-26T14:58:59.671 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 18.0.0-4629-g1e8a39f3 (1e8a39f359d8481bb3038b461063c87384bf3ee8) reef (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x120) [0x7f5ab3f7c7ff]
,  2: (ceph::register_assert_context(ceph::common::CephContext*)+0) [0x7f5ab3f7ca2a]

2023-06-26T14:58:59.673 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T03:33:31.145+0000 7f99d9e15700 -1 WARNING: the following dangerous and experimental features are enabled: crimson
, 2023-06-26T03:33:31.154+0000 7f99d9e15700 -1 WARNING: the following dangerous and experimental features are enabled: crimson
, set osd.3 primary-affinity to 1 (8655362)

2023-06-26T14:58:59.673 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T03:33:37.084 INFO:teuthology.orchestra.run.smithi061.stdout:
, dumped all
, 2023-06-26T03:33:37.098 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-06-26T03:33:36.128532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1203408841,"num_objects":401,"num_object_clones":0,"num_object_copies":1203,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13150,"num_read_kb":9768595,"num_write":8796,"num_write_kb":2542536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":496250954,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7560,"ondisk_log_size":7560,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":377487360,"kb_used":2804784,"kb_used_data":2578576,"kb_used_omap":0,"kb_used_meta":226176,"kb_avail":374682576,"statfs":{"total":386547056640,"available":383674957824,"internally_reserved":0,"allocated":2640461824,"data_stored":2620665169,"data_compressed":89751,"data_compressed_allocated":122880,"data_compressed_original":1720320,"omap_allocated":0,"internal_metadata":231604224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.135159"},"pg_stats":[{"pgid":"3.f","version":"22'474","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-26T03:33:31.157904+0000","last_change":"2023-06-26T03:33:19.881706+0000","last_active":"2023-06-26T03:33:31.157904+0000","last_peered":"2023-06-26T03:33:31.157904+0000","last_clean":"2023-06-26T03:33:31.157904+0000","last_became_active":"2023-06-26T03:33:19.878659+0000","last_became_peered":"2023-06-26T03:33:19.878659+0000","last_unstale":"2023-06-26T03:33:31.157904+0000","last_undegraded":"2023-06-26T03:33:31.157904+0000","last_fullsized":"2023-06-26T03:33:31.157904+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12827,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":52336274,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"32'432","reported_seq":884,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.965133+0000","last_change":"2023-06-26T03:33:14.046533+0000","last_active":"2023-06-26T03:33:32.965133+0000","last_peered":"2023-06-26T03:33:32.965133+0000","last_clean":"2023-06-26T03:33:32.965133+0000","last_became_active":"2023-06-26T03:33:14.038723+0000","last_became_peered":"2023-06-26T03:33:14.038723+0000","last_unstale":"2023-06-26T03:33:32.965133+0000","last_undegraded":"2023-06-26T03:33:32.965133+0000","last_fullsized":"2023-06-26T03:33:32.965133+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72432385,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":654,"num_read_kb":446879,"num_write":538,"num_write_kb":157922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":48628713,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"31'519","reported_seq":1068,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.020737+0000","last_change":"2023-06-26T03:28:12.935366+0000","last_active":"2023-06-26T03:33:32.020737+0000","last_peered":"2023-06-26T03:33:32.020737+0000","last_clean":"2023-06-26T03:33:32.020737+0000","last_became_active":"2023-06-26T03:28:12.932005+0000","last_became_peered":"2023-06-26T03:28:12.932005+0000","last_unstale":"2023-06-26T03:33:32.020737+0000","last_undegraded":"2023-06-26T03:33:32.020737+0000","last_fullsized":"2023-06-26T03:33:32.020737+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":519,"log_dups_size":0,"ondisk_log_size":519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101294360,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1025,"num_read_kb":749085,"num_write":655,"num_write_kb":190173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"25'511","reported_seq":1025,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.021337+0000","last_change":"2023-06-26T03:28:12.935230+0000","last_active":"2023-06-26T03:33:32.021337+0000","last_peered":"2023-06-26T03:33:32.021337+0000","last_clean":"2023-06-26T03:33:32.021337+0000","last_became_active":"2023-06-26T03:28:12.932318+0000","last_became_peered":"2023-06-26T03:28:12.932318+0000","last_unstale":"2023-06-26T03:33:32.021337+0000","last_undegraded":"2023-06-26T03:33:32.021337+0000","last_fullsized":"2023-06-26T03:33:32.021337+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91308065,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":956,"num_read_kb":716586,"num_write":640,"num_write_kb":190106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"30'427","reported_seq":908,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.971256+0000","last_change":"2023-06-26T03:28:12.971493+0000","last_active":"2023-06-26T03:33:32.971256+0000","last_peered":"2023-06-26T03:33:32.971256+0000","last_clean":"2023-06-26T03:33:32.971256+0000","last_became_active":"2023-06-26T03:28:12.968594+0000","last_became_peered":"2023-06-26T03:28:12.968594+0000","last_unstale":"2023-06-26T03:33:32.971256+0000","last_undegraded":"2023-06-26T03:33:32.971256+0000","last_fullsized":"2023-06-26T03:33:32.971256+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79811021,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":879,"num_read_kb":643829,"num_write":538,"num_write_kb":157649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"31'446","reported_seq":962,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.013982+0000","last_change":"2023-06-26T03:33:11.024784+0000","last_active":"2023-06-26T03:33:32.013982+0000","last_peered":"2023-06-26T03:33:32.013982+0000","last_clean":"2023-06-26T03:33:32.013982+0000","last_became_active":"2023-06-26T03:33:11.021791+0000","last_became_peered":"2023-06-26T03:33:11.021791+0000","last_unstale":"2023-06-26T03:33:32.013982+0000","last_undegraded":"2023-06-26T03:33:32.013982+0000","last_fullsized":"2023-06-26T03:33:32.013982+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83928274,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":805,"num_read_kb":600578,"num_write":555,"num_write_kb":161312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":29,"num_bytes_recovered":51237268,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"28'474","reported_seq":1029,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.024984+0000","last_change":"2023-06-26T03:33:11.019328+0000","last_active":"2023-06-26T03:33:32.024984+0000","last_peered":"2023-06-26T03:33:32.024984+0000","last_clean":"2023-06-26T03:33:32.024984+0000","last_became_active":"2023-06-26T03:33:11.015940+0000","last_became_peered":"2023-06-26T03:33:11.015940+0000","last_unstale":"2023-06-26T03:33:32.024984+0000","last_undegraded":"2023-06-26T03:33:32.024984+0000","last_fullsized":"2023-06-26T03:33:32.024984+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":85173510,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":867,"num_read_kb":640592,"num_write":603,"num_write_kb":177355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":54241940,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"29'408","reported_seq":851,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.020899+0000","last_change":"2023-06-26T03:28:12.988945+0000","last_active":"2023-06-26T03:33:32.020899+0000","last_peered":"2023-06-26T03:33:32.020899+0000","last_clean":"2023-06-26T03:33:32.020899+0000","last_became_active":"2023-06-26T03:28:12.977936+0000","last_became_peered":"2023-06-26T03:28:12.977936+0000","last_unstale":"2023-06-26T03:33:32.020899+0000","last_undegraded":"2023-06-26T03:33:32.020899+0000","last_fullsized":"2023-06-26T03:33:32.020899+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72735505,"num_objects":25,"num_object_clones":0,"num_object_copies":75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":793,"num_read_kb":641636,"num_write":511,"num_write_kb":150735,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.981112+0000","last_change":"2023-06-26T03:33:04.032677+0000","last_active":"2023-06-26T03:33:32.981112+0000","last_peered":"2023-06-26T03:33:32.981112+0000","last_clean":"2023-06-26T03:33:32.981112+0000","last_became_active":"2023-06-26T03:33:04.021706+0000","last_became_peered":"2023-06-26T03:33:04.021706+0000","last_unstale":"2023-06-26T03:33:32.981112+0000","last_undegraded":"2023-06-26T03:33:32.981112+0000","last_fullsized":"2023-06-26T03:33:32.981112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'444","reported_seq":788,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-26T03:33:31.152204+0000","last_change":"2023-06-26T03:33:11.003758+0000","last_active":"2023-06-26T03:33:31.152204+0000","last_peered":"2023-06-26T03:33:31.152204+0000","last_clean":"2023-06-26T03:33:31.152204+0000","last_became_active":"2023-06-26T03:33:11.000588+0000","last_became_peered":"2023-06-26T03:33:11.000588+0000","last_unstale":"2023-06-26T03:33:31.152204+0000","last_undegraded":"2023-06-26T03:33:31.152204+0000","last_fullsized":"2023-06-26T03:33:31.152204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4153243,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":661489,"num_write":438,"num_write_kb":127217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":47436104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.023927+0000","last_change":"2023-06-26T03:33:04.005514+0000","last_active":"2023-06-26T03:33:32.023927+0000","last_peered":"2023-06-26T03:33:32.023927+0000","last_clean":"2023-06-26T03:33:32.023927+0000","last_became_active":"2023-06-26T03:33:03.995911+0000","last_became_peered":"2023-06-26T03:33:03.995911+0000","last_unstale":"2023-06-26T03:33:32.023927+0000","last_undegraded":"2023-06-26T03:33:32.023927+0000","last_fullsized":"2023-06-26T03:33:32.023927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'415","reported_seq":927,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.991289+0000","last_change":"2023-06-26T03:33:16.028748+0000","last_active":"2023-06-26T03:33:32.991289+0000","last_peered":"2023-06-26T03:33:32.991289+0000","last_clean":"2023-06-26T03:33:32.991289+0000","last_became_active":"2023-06-26T03:33:16.024169+0000","last_became_peered":"2023-06-26T03:33:16.024169+0000","last_unstale":"2023-06-26T03:33:32.991289+0000","last_undegraded":"2023-06-26T03:33:32.991289+0000","last_fullsized":"2023-06-26T03:33:32.991289+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74465570,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":819,"num_read_kb":646413,"num_write":517,"num_write_kb":153491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":43055054,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":68,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-26T03:33:31.146923+0000","last_change":"2023-06-26T03:33:03.971932+0000","last_active":"2023-06-26T03:33:31.146923+0000","last_peered":"2023-06-26T03:33:31.146923+0000","last_clean":"2023-06-26T03:33:31.146923+0000","last_became_active":"2023-06-26T03:33:03.962368+0000","last_became_peered":"2023-06-26T03:33:03.962368+0000","last_unstale":"2023-06-26T03:33:31.146923+0000","last_undegraded":"2023-06-26T03:33:31.146923+0000","last_fullsized":"2023-06-26T03:33:31.146923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"33'467","reported_seq":1001,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.966109+0000","last_change":"2023-06-26T03:33:14.037875+0000","last_active":"2023-06-26T03:33:32.966109+0000","last_peered":"2023-06-26T03:33:32.966109+0000","last_clean":"2023-06-26T03:33:32.966109+0000","last_became_active":"2023-06-26T03:33:14.032805+0000","last_became_peered":"2023-06-26T03:33:14.032805+0000","last_unstale":"2023-06-26T03:33:32.966109+0000","last_undegraded":"2023-06-26T03:33:32.966109+0000","last_fullsized":"2023-06-26T03:33:32.966109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87241101,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":829,"num_read_kb":655593,"num_write":593,"num_write_kb":176603,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":51495841,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.007855+0000","last_change":"2023-06-26T03:33:03.975638+0000","last_active":"2023-06-26T03:33:32.007855+0000","last_peered":"2023-06-26T03:33:32.007855+0000","last_clean":"2023-06-26T03:33:32.007855+0000","last_became_active":"2023-06-26T03:33:03.972496+0000","last_became_peered":"2023-06-26T03:33:03.972496+0000","last_unstale":"2023-06-26T03:33:32.007855+0000","last_undegraded":"2023-06-26T03:33:32.007855+0000","last_fullsized":"2023-06-26T03:33:32.007855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":207,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.969923+0000","last_change":"2023-06-26T03:33:04.001440+0000","last_active":"2023-06-26T03:33:32.969923+0000","last_peered":"2023-06-26T03:33:32.969923+0000","last_clean":"2023-06-26T03:33:32.969923+0000","last_became_active":"2023-06-26T03:33:03.994797+0000","last_became_peered":"2023-06-26T03:33:03.994797+0000","last_unstale":"2023-06-26T03:33:32.969923+0000","last_undegraded":"2023-06-26T03:33:32.969923+0000","last_fullsized":"2023-06-26T03:33:32.969923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"31'349","reported_seq":780,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.008730+0000","last_change":"2023-06-26T03:33:13.016200+0000","last_active":"2023-06-26T03:33:32.008730+0000","last_peered":"2023-06-26T03:33:32.008730+0000","last_clean":"2023-06-26T03:33:32.008730+0000","last_became_active":"2023-06-26T03:33:13.013216+0000","last_became_peered":"2023-06-26T03:33:13.013216+0000","last_unstale":"2023-06-26T03:33:32.008730+0000","last_undegraded":"2023-06-26T03:33:32.008730+0000","last_fullsized":"2023-06-26T03:33:32.008730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59118799,"num_objects":20,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":657,"num_read_kb":512776,"num_write":443,"num_write_kb":129765,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":37455466,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.023296+0000","last_change":"2023-06-26T03:33:03.965798+0000","last_active":"2023-06-26T03:33:32.023296+0000","last_peered":"2023-06-26T03:33:32.023296+0000","last_clean":"2023-06-26T03:33:32.023296+0000","last_became_active":"2023-06-26T03:33:03.956975+0000","last_became_peered":"2023-06-26T03:33:03.956975+0000","last_unstale":"2023-06-26T03:33:32.023296+0000","last_undegraded":"2023-06-26T03:33:32.023296+0000","last_fullsized":"2023-06-26T03:33:32.023296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'499","reported_seq":1073,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.989923+0000","last_change":"2023-06-26T03:33:18.067146+0000","last_active":"2023-06-26T03:33:32.989923+0000","last_peered":"2023-06-26T03:33:32.989923+0000","last_clean":"2023-06-26T03:33:32.989923+0000","last_became_active":"2023-06-26T03:33:18.060805+0000","last_became_peered":"2023-06-26T03:33:18.060805+0000","last_unstale":"2023-06-26T03:33:32.989923+0000","last_undegraded":"2023-06-26T03:33:32.989923+0000","last_fullsized":"2023-06-26T03:33:32.989923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98419274,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":919,"num_read_kb":664725,"num_write":629,"num_write_kb":185815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":51982509,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.972318+0000","last_change":"2023-06-26T03:33:03.975155+0000","last_active":"2023-06-26T03:33:32.972318+0000","last_peered":"2023-06-26T03:33:32.972318+0000","last_clean":"2023-06-26T03:33:32.972318+0000","last_became_active":"2023-06-26T03:33:03.966827+0000","last_became_peered":"2023-06-26T03:33:03.966827+0000","last_unstale":"2023-06-26T03:33:32.972318+0000","last_undegraded":"2023-06-26T03:33:32.972318+0000","last_fullsized":"2023-06-26T03:33:32.972318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"33'667","reported_seq":1350,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.965272+0000","last_change":"2023-06-26T03:28:12.995749+0000","last_active":"2023-06-26T03:33:32.965272+0000","last_peered":"2023-06-26T03:33:32.965272+0000","last_clean":"2023-06-26T03:33:32.965272+0000","last_became_active":"2023-06-26T03:28:12.992276+0000","last_became_peered":"2023-06-26T03:28:12.992276+0000","last_unstale":"2023-06-26T03:33:32.965272+0000","last_undegraded":"2023-06-26T03:33:32.965272+0000","last_fullsized":"2023-06-26T03:33:32.965272+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124811775,"num_objects":43,"num_object_clones":0,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1313,"num_read_kb":983801,"num_write":839,"num_write_kb":243360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"32'342","reported_seq":724,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.975612+0000","last_change":"2023-06-26T03:28:12.985762+0000","last_active":"2023-06-26T03:33:32.975612+0000","last_peered":"2023-06-26T03:33:32.975612+0000","last_clean":"2023-06-26T03:33:32.975612+0000","last_became_active":"2023-06-26T03:28:12.976594+0000","last_became_peered":"2023-06-26T03:28:12.976594+0000","last_unstale":"2023-06-26T03:33:32.975612+0000","last_undegraded":"2023-06-26T03:33:32.975612+0000","last_fullsized":"2023-06-26T03:33:32.975612+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64262797,"num_objects":21,"num_object_clones":0,"num_object_copies":63,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":688,"num_read_kb":481691,"num_write":421,"num_write_kb":122131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.970968+0000","last_change":"2023-06-26T03:33:03.991445+0000","last_active":"2023-06-26T03:33:32.970968+0000","last_peered":"2023-06-26T03:33:32.970968+0000","last_clean":"2023-06-26T03:33:32.970968+0000","last_became_active":"2023-06-26T03:33:03.988463+0000","last_became_peered":"2023-06-26T03:33:03.988463+0000","last_unstale":"2023-06-26T03:33:32.970968+0000","last_undegraded":"2023-06-26T03:33:32.970968+0000","last_fullsized":"2023-06-26T03:33:32.970968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.011810+0000","last_change":"2023-06-26T03:33:03.975627+0000","last_active":"2023-06-26T03:33:32.011810+0000","last_peered":"2023-06-26T03:33:32.011810+0000","last_clean":"2023-06-26T03:33:32.011810+0000","last_became_active":"2023-06-26T03:33:03.972087+0000","last_became_peered":"2023-06-26T03:33:03.972087+0000","last_unstale":"2023-06-26T03:33:32.011810+0000","last_undegraded":"2023-06-26T03:33:32.011810+0000","last_fullsized":"2023-06-26T03:33:32.011810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:04.760439+0000","last_clean_scrub_stamp":"2023-06-26T03:28:04.760439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"32'589","reported_seq":1218,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-06-26T03:33:32.991465+0000","last_change":"2023-06-26T03:33:18.915860+0000","last_active":"2023-06-26T03:33:32.991465+0000","last_peered":"2023-06-26T03:33:32.991465+0000","last_clean":"2023-06-26T03:33:32.991465+0000","last_became_active":"2023-06-26T03:33:18.911049+0000","last_became_peered":"2023-06-26T03:33:18.911049+0000","last_unstale":"2023-06-26T03:33:32.991465+0000","last_undegraded":"2023-06-26T03:33:32.991465+0000","last_fullsized":"2023-06-26T03:33:32.991465+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-26T03:28:11.779682+0000","last_clean_scrub_stamp":"2023-06-26T03:28:11.779682+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":103662794,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1010,"num_read_kb":710004,"num_write":739,"num_write_kb":217008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":35,"num_bytes_recovered":58381785,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1202818473,"num_objects":399,"num_object_clones":0,"num_object_copies":1197,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13047,"num_read_kb":9768504,"num_write":8659,"num_write_kb":2540642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":496250954,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7463,"ondisk_log_size":7463,"up":48,"acting":48,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":3,"acting":3,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":0}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":690496,"kb_used_data":641528,"kb_used_omap":0,"kb_used_meta":48960,"kb_avail":93681344,"statfs":{"total":96636764160,"available":95929696256,"internally_reserved":0,"allocated":656924672,"data_stored":653426010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50135040},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":2,"up_from":23,"seq":98784248137,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":566444,"kb_used_data":531428,"kb_used_omap":0,"kb_used_meta":35008,"kb_avail":93805396,"statfs":{"total":96636764160,"available":96056725504,"internally_reserved":0,"allocated":544182272,"data_stored":534405257,"data_compressed":29917,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":35848192},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":781300,"kb_used_data":710188,"kb_used_omap":0,"kb_used_meta":71104,"kb_avail":93590540,"statfs":{"total":96636764160,"available":95836712960,"internally_reserved":0,"allocated":727232512,"data_stored":723937186,"data_compressed":29917,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72810496},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":9,"seq":38654705994,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":766544,"kb_used_data":695432,"kb_used_omap":0,"kb_used_meta":71104,"kb_avail":93605296,"statfs":{"total":96636764160,"available":95851823104,"internally_reserved":0,"allocated":712122368,"data_stored":708896716,"data_compressed":29917,"data_compressed_allocated":40960,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":72810496},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}}

2023-06-26T14:58:59.675 WARNING:scrape:Ignoring malparsed backtrace: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.107428.log
, gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112777.log
, /var/log/ceph/ceph-client.0.107428.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120024.log

2023-06-26T14:58:59.676 WARNING:scrape:Ignoring malparsed backtrace:  50.0% -- replaced with /var/log/ceph/ceph-client.admin.118035.log.gz
, /var/log/ceph/ceph-client.admin.106415.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114064.log
,  50.0% -- replaced with /var/log/ceph/ceph-client.admin.106415.log.gz

2023-06-26T14:58:59.676 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.105219.log:	gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log
,  49.6% -- replaced with /var/log/ceph/ceph-client.admin.105219.log.gz
, /var/log/ceph/ceph-client.admin.105267.log:	 50.0% -- replaced with /var/log/ceph/ceph-client.admin.105267.log.gz

2023-06-26T14:58:59.677 WARNING:scrape:Ignoring malparsed backtrace:  50.0% -- replaced with /var/log/ceph/ceph-client.admin.109942.log.gz
, /var/log/ceph/ceph-client.admin.109613.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117981.log
,  50.4% -- replaced with /var/log/ceph/ceph-client.admin.109613.log.gz

2023-06-26T14:58:59.677 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.110983.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119850.log
,  50.0% -- replaced with /var/log/ceph/ceph-client.admin.110983.log.gz
, /var/log/ceph/ceph-client.admin.108264.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109566.log

2023-06-26T14:58:59.678 WARNING:scrape:Ignoring malparsed backtrace: /var/log/ceph/ceph-client.admin.119801.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118164.log
,  49.6% -- replaced with /var/log/ceph/ceph-client.admin.119801.log.gz
, /var/log/ceph/ceph-client.admin.109100.log:	gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112089.log

2023-06-26T14:58:59.678 WARNING:scrape:Ignoring malparsed backtrace:  91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz
,  91.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz
, 

2023-06-26T14:58:59.678 WARNING:scrape:Ignoring malparsed backtrace: 2023-06-26T03:34:10.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive
, 2023-06-26T03:34:10.457 INFO:teuthology.task.internal:Transferring archived files...
, 2023-06-26T03:34:10.459 DEBUG:teuthology.misc:Transferring archived files from smithi061:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316146/remote/smithi061

2023-06-26T14:59:03.012 INFO:scrape:Found 9 distinct failure reasons
2023-06-26T14:59:03.014 INFO:scrape:Dead: b'2023-06-26T03:31:54.055 INFO:tasks.rados.rados.0.smithi006.stdout:888:  left oid 347 (ObjNum 715 snap 0 seq_num 715)'
2023-06-26T14:59:03.014 INFO:scrape:1 jobs: ['7316141']
2023-06-26T14:59:03.014 INFO:scrape:suites: ['clusters/fixed-2', 'crimson-rados/basic/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/readwrite}']
2023-06-26T14:59:03.015 INFO:scrape:
2023-06-26T14:59:03.015 INFO:scrape:Dead: b'2023-06-26T14:58:58.329 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json'
2023-06-26T14:59:03.015 INFO:scrape:1 jobs: ['7316132']
2023-06-26T14:59:03.016 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/radosbench-high-concurrency}']
2023-06-26T14:59:03.016 INFO:scrape:
2023-06-26T14:59:03.016 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh
2023-06-26T14:59:03.017 INFO:scrape:1 jobs: ['7316127']
2023-06-26T14:59:03.018 INFO:scrape:suites: ['clusters/fixed-2', 'crimson-rados/basic/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rados_api_tests}']
2023-06-26T14:59:03.018 INFO:scrape:
2023-06-26T14:59:03.019 INFO:scrape:Failure: reached maximum tries (801) after waiting for 4800 seconds
2023-06-26T14:59:03.019 INFO:scrape:1 jobs: ['7316129']
2023-06-26T14:59:03.019 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/admin_socket_objecter_requests}']
2023-06-26T14:59:03.019 INFO:scrape:
2023-06-26T14:59:03.020 INFO:scrape:Dead: b'2023-06-26T14:58:57.030 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":43,"fsid":"84d19148-2712-4047-b532-2f378d86a40d","created":"2023-06-26T03:28:19.692406+0000","modified":"2023-06-26T03:39:15.795820+0000","last_up_change":"2023-06-26T03:33:28.749767+0000","last_in_change":"2023-06-26T03:38:59.788364+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-26T03:28:29.921172+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0\'0","target_version":"0\'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-26T03:28:30.302721+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0\'0","target_version":"0\'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":0.75,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2023-06-26T03:28:37.373205+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0\'0","target_version":"0\'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":0.75,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67833c52-db06-4978-9172-df83097aea9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6801","nonce":1654194804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":1654194804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6805","nonce":1654194804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":1654194804}]},"public_addr":"172.21.15.32:6801/1654194804","cluster_addr":"172.21.15.32:6800/1654194804","heartbeat_back_addr":"172.21.15.32:6805/1654194804","heartbeat_front_addr":"172.21.15.32:6804/1654194804","state":["exists","up"]},{"osd":1,"uuid":"601145b9-f290-4a62-a17c-c14aa9b474e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6803","nonce":2821681244}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":2821681244}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6807","nonce":2821681244}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":2821681244}]},"public_addr":"172.21.15.32:6803/2821681244","cluster_addr":"172.21.15.32:6802/2821681244","heartbeat_back_addr":"172.21.15.32:6807/2821681244","heartbeat_front_addr":"172.21.15.32:6806/2821681244","state":["exists","up"]},{"osd":2,"uuid":"4e5437c0-3cb6-4ac8-b3cb-ae719e05f6e4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":17,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6803","nonce":3212879856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3212879856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3212879856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6807","nonce":3212879856}]},"public_addr":"172.21.15.102:6803/3212879856","cluster_addr":"172.21.15.102:6802/3212879856","heartbeat_back_addr":"172.21.15.102:6806/3212879856","heartbeat_front_addr":"172.21.15.102:6807/3212879856","state":["autoout","exists"]},{"osd":3,"uuid":"f16cbbb6-7be4-4f6c-8817-c69936bdef6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":28,"up_from":29,"up_thru":42,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":457770503}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6805","nonce":457770503}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":457770503}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6809","nonce":457770503}]},"public_addr":"172.21.15.102:6804/457770503","cluster_addr":"172.21.15.102:6805/457770503","heartbeat_back_addr":"172.21.15.102:6808/457770503","heartbeat_front_addr":"172.21.15.102:6809/457770503","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"2023-06-26T03:28:57.730212+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":65536,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"2023-06-26T03:29:51.864116+0000","laggy_probability":0.30000001192092896,"laggy_interval":65,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}'
2023-06-26T14:59:03.021 INFO:scrape:2 jobs: ['7316139', '7316137']
2023-06-26T14:59:03.021 INFO:scrape:suites intersection: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health']
2023-06-26T14:59:03.022 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/small-objects-localized}', 'workloads/small-objects}']
2023-06-26T14:59:03.022 INFO:scrape:
2023-06-26T14:59:03.022 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --write-fadvise-dontneed --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 10 --op write_excl 50 --pool unique_pool_0'
2023-06-26T14:59:03.023 INFO:scrape:1 jobs: ['7316146']
2023-06-26T14:59:03.023 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/write_fadvise_dontneed}']
2023-06-26T14:59:03.024 INFO:scrape:
2023-06-26T14:59:03.024 INFO:scrape:Dead: b'2023-06-26T14:58:57.806 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":1054,"fsid":"098f13d3-a622-4491-855a-adcfe5c695ca","created":"2023-06-26T03:24:28.933283+0000","modified":"2023-06-26T03:42:24.168314+0000","last_up_change":"2023-06-26T03:25:25.067997+0000","last_in_change":"2023-06-26T03:42:19.166530+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-26T03:24:37.276591+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0\'0","target_version":"0\'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.75,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-26T03:24:39.481845+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0\'0","target_version":"0\'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":0.75,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7b8293b9-ae59-40a5-baff-062b000734ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":1050,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6801","nonce":1667280877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":1667280877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":1667280877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6805","nonce":1667280877}]},"public_addr":"172.21.15.79:6801/1667280877","cluster_addr":"172.21.15.79:6800/1667280877","heartbeat_back_addr":"172.21.15.79:6804/1667280877","heartbeat_front_addr":"172.21.15.79:6805/1667280877","state":["exists","up"]},{"osd":1,"uuid":"98bae7ff-c853-4120-95a1-7d478668b1a9","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":16,"down_at":52,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6803","nonce":977844584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":977844584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6807","nonce":977844584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":977844584}]},"public_addr":"172.21.15.79:6803/977844584","cluster_addr":"172.21.15.79:6802/977844584","heartbeat_back_addr":"172.21.15.79:6807/977844584","heartbeat_front_addr":"172.21.15.79:6806/977844584","state":["autoout","exists"]},{"osd":2,"uuid":"2cf6a466-eead-4b82-9bdc-3fbc7768ffd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":4107379208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6805","nonce":4107379208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6808","nonce":4107379208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6809","nonce":4107379208}]},"public_addr":"172.21.15.196:6804/4107379208","cluster_addr":"172.21.15.196:6805/4107379208","heartbeat_back_addr":"172.21.15.196:6808/4107379208","heartbeat_front_addr":"172.21.15.196:6809/4107379208","state":["exists","up"]},{"osd":3,"uuid":"69f70631-51e3-4e15-b2d7-b6b4030278f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":1050,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":1098908931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6803","nonce":1098908931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":1098908931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":1098908931}]},"public_addr":"172.21.15.196:6802/1098908931","cluster_addr":"172.21.15.196:6803/1098908931","heartbeat_back_addr":"172.21.15.196:6807/1098908931","heartbeat_front_addr":"172.21.15.196:6806/1098908931","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"2023-06-26T03:25:25.067997+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":65536,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":1,"length":2},{"begin":4,"length":1},{"begin":7,"length":3},{"begin":13,"length":1},{"begin":15,"length":2},{"begin":19,"length":1},{"begin":21,"length":4},{"begin":26,"length":1},{"begin":30,"length":2},{"begin":35,"length":3},{"begin":39,"length":1},{"begin":41,"length":2},{"begin":44,"length":1},{"begin":48,"length":1},{"begin":50,"length":2},{"begin":54,"length":1},{"begin":56,"length":3},{"begin":60,"length":2},{"begin":63,"length":1},{"begin":67,"length":4},{"begin":74,"length":1},{"begin":76,"length":4},{"begin":81,"length":2},{"begin":85,"length":1},{"begin":88,"length":1},{"begin":90,"length":2},{"begin":93,"length":6},{"begin":100,"length":3},{"begin":105,"length":1},{"begin":107,"length":1},{"begin":110,"length":2},{"begin":113,"length":3},{"begin":117,"length":2},{"begin":120,"length":2},{"begin":123,"length":1},{"begin":134,"length":2},{"begin":137,"length":2},{"begin":141,"length":1},{"begin":144,"length":2},{"begin":147,"length":1},{"begin":149,"length":3},{"begin":159,"length":1},{"begin":161,"length":1},{"begin":164,"length":1},{"begin":168,"length":1},{"begin":170,"length":1},{"begin":172,"length":1},{"begin":175,"length":1},{"begin":177,"length":3},{"begin":183,"length":2},{"begin":187,"length":1},{"begin":189,"length":1},{"begin":191,"length":1},{"begin":193,"length":2},{"begin":197,"length":2},{"begin":201,"length":3},{"begin":207,"length":4},{"begin":214,"length":1},{"begin":217,"length":4},{"begin":225,"length":1},{"begin":227,"length":3},{"begin":232,"length":5},{"begin":239,"length":1},{"begin":242,"length":1},{"begin":245,"length":1},{"begin":247,"length":2},{"begin":250,"length":1},{"begin":252,"length":1},{"begin":255,"length":3},{"begin":262,"length":1},{"begin":265,"length":3},{"begin":269,"length":2},{"begin":273,"length":2},{"begin":276,"length":1},{"begin":279,"length":1},{"begin":283,"length":3},{"begin":287,"length":2},{"begin":290,"length":2},{"begin":294,"length":1},{"begin":296,"length":2},{"begin":302,"length":3},{"begin":306,"length":1},{"begin":308,"length":3},{"begin":312,"length":1},{"begin":315,"length":1},{"begin":318,"length":2},{"begin":322,"length":1},{"begin":325,"length":2},{"begin":328,"length":7},{"begin":337,"length":1},{"begin":341,"length":1},{"begin":344,"length":2},{"begin":347,"length":3},{"begin":352,"length":1},{"begin":356,"length":4},{"begin":362,"length":2},{"begin":368,"length":1},{"begin":372,"length":3},{"begin":376,"length":2},{"begin":379,"length":1},{"begin":381,"length":1},{"begin":384,"length":4},{"begin":392,"length":1},{"begin":395,"length":1},{"begin":400,"length":1},{"begin":402,"length":1},{"begin":404,"length":1},{"begin":406,"length":1},{"begin":408,"length":1},{"begin":410,"length":2},{"begin":414,"length":3},{"begin":419,"length":1},{"begin":421,"length":2},{"begin":424,"length":4},{"begin":431,"length":1},{"begin":437,"length":4},{"begin":442,"length":2},{"begin":445,"length":1},{"begin":449,"length":1},{"begin":453,"length":1},{"begin":455,"length":2},{"begin":459,"length":2},{"begin":462,"length":3},{"begin":466,"length":1},{"begin":468,"length":2},{"begin":472,"length":1},{"begin":476,"length":1},{"begin":478,"length":1},{"begin":481,"length":5},{"begin":488,"length":4},{"begin":493,"length":1},{"begin":495,"length":2},{"begin":498,"length":2},{"begin":502,"length":1},{"begin":505,"length":1},{"begin":508,"length":3},{"begin":513,"length":1},{"begin":516,"length":3},{"begin":525,"length":4},{"begin":530,"length":1},{"begin":533,"length":1},{"begin":535,"length":3},{"begin":539,"length":8},{"begin":548,"length":1},{"begin":551,"length":2},{"begin":554,"length":2},{"begin":558,"length":2},{"begin":561,"length":2},{"begin":564,"length":1},{"begin":568,"length":3},{"begin":572,"length":4},{"begin":577,"length":1},{"begin":579,"length":1},{"begin":583,"length":1},{"begin":593,"length":1},{"begin":595,"length":5},{"begin":601,"length":1},{"begin":603,"length":1},{"begin":606,"length":1},{"begin":614,"length":3},{"begin":618,"length":3},{"begin":623,"length":5},{"begin":629,"length":4},{"begin":635,"length":2},{"begin":639,"length":1},{"begin":643,"length":3},{"begin":647,"length":1},{"begin":651,"length":5},{"begin":660,"length":2},{"begin":665,"length":6},{"begin":673,"length":1},{"begin":675,"length":1},{"begin":679,"length":1},{"begin":687,"length":1},{"begin":690,"length":1},{"begin":693,"length":1},{"begin":696,"length":1},{"begin":698,"length":2},{"begin":701,"length":1},{"begin":703,"length":4},{"begin":708,"length":1},{"begin":710,"length":1},{"begin":712,"length":1},{"begin":714,"length":4},{"begin":719,"length":1},{"begin":722,"length":1},{"begin":724,"length":1},{"begin":726,"length":3},{"begin":731,"length":2},{"begin":735,"length":8},{"begin":744,"length":4},{"begin":749,"length":2},{"begin":753,"length":1},{"begin":755,"length":1},{"begin":757,"length":2},{"begin":761,"length":1},{"begin":765,"length":1},{"begin":775,"length":2},{"begin":781,"length":1},{"begin":784,"length":1},{"begin":786,"length":3},{"begin":790,"length":1},{"begin":793,"length":1},{"begin":795,"length":1},{"begin":800,"length":1},{"begin":802,"length":1},{"begin":806,"length":2},{"begin":809,"length":2},{"begin":812,"length":1},{"begin":814,"length":5},{"begin":821,"length":1},{"begin":825,"length":2},{"begin":828,"length":1},{"begin":830,"length":1},{"begin":833,"length":4},{"begin":838,"length":4},{"begin":844,"length":1},{"begin":846,"length":2},{"begin":849,"length":1},{"begin":856,"length":1},{"begin":858,"length":1},{"begin":860,"length":6},{"begin":867,"length":1},{"begin":870,"length":1},{"begin":874,"length":5},{"begin":880,"length":2},{"begin":883,"length":2},{"begin":887,"length":4},{"begin":897,"length":1},{"begin":899,"length":2},{"begin":905,"length":1},{"begin":909,"length":1},{"begin":913,"length":1},{"begin":915,"length":4},{"begin":920,"length":1},{"begin":923,"length":2},{"begin":926,"length":2},{"begin":930,"length":6},{"begin":940,"length":1},{"begin":945,"length":1},{"begin":948,"length":2},{"begin":952,"length":1},{"begin":954,"length":4},{"begin":962,"length":1},{"begin":964,"length":1},{"begin":969,"length":2},{"begin":972,"length":1},{"begin":974,"length":2},{"begin":978,"length":1},{"begin":980,"length":2},{"begin":992,"length":3},{"begin":997,"length":2},{"begin":1005,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}'
2023-06-26T14:59:03.025 INFO:scrape:1 jobs: ['7316130']
2023-06-26T14:59:03.025 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/pool-snaps-few-objects}']
2023-06-26T14:59:03.026 INFO:scrape:
2023-06-26T14:59:03.026 INFO:scrape:Dead: b'2023-06-26T14:58:59.464 INFO:teuthology.orchestra.run.smithi040.stderr:'
2023-06-26T14:59:03.027 INFO:scrape:2 jobs: ['7316140', '7316143']
2023-06-26T14:59:03.027 INFO:scrape:suites intersection: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health']
2023-06-26T14:59:03.028 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', 'centos_latest', 'clusters/{fixed-2}', 'crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'crimson_qa_overrides', 'deploy/ceph', 'objectstore/bluestore', 'thrashers/default', 'thrashosds-health', 'workloads/snaps-few-objects-balanced}', 'workloads/snaps-few-objects-localized}']
2023-06-26T14:59:03.029 INFO:scrape:
2023-06-26T14:59:03.029 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/crimson/test_crimson_librbd.sh
2023-06-26T14:59:03.030 INFO:scrape:1 jobs: ['7316128']
2023-06-26T14:59:03.031 INFO:scrape:suites: ['clusters/fixed-1', 'crimson-rados/rbd/{centos_latest', 'crimson_qa_overrides', 'deploy/ceph', 'tasks/rbd_api_tests}']
2023-06-26T14:59:03.031 INFO:scrape:
2023-06-26T14:59:03.038 INFO:teuthology.results:Sending results to yingxin.cheng@intel.com: Test Run: yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/
failed:  4
dead:    0
running: 7
waiting: 0
queued:  0
passed:  9


Fail
=================================================================
[7316127]  crimson-rados/basic/{centos_latest clusters/fixed-2 crimson_qa_overrides deploy/ceph tasks/rados_api_tests}
-----------------------------------------------------------------
time:   03:41:22
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316127/
log:    http://qa-proxy.ceph.com/teuthology/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316127/
sentry: https://sentry.ceph.com/organizations/ceph/?query=886e68146c9242b9adf414df1c450b66

    Command failed (workunit test rados/test.sh) on smithi130 with status 124:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=1e8a39f359d8481bb3038b461063c87384bf3ee8
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

[7316128]  crimson-rados/rbd/{centos_latest clusters/fixed-1 crimson_qa_overrides deploy/ceph tasks/rbd_api_tests}
-----------------------------------------------------------------
time:   03:20:40
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316128/
log:    http://qa-proxy.ceph.com/teuthology/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316128/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eaddd9056b0a4a6382522c4d9045fc6f

    Command failed (workunit test rbd/crimson/test_crimson_librbd.sh) on
    smithi007 with status 124: 'mkdir -p --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=1e8a39f359d8481bb3038b461063c87384bf3ee8
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 CRIMSON_COMPAT=1
    adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout
    3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/crimson/test_crims
    on_librbd.sh'

[7316129]  crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/admin_socket_objecter_requests}
-----------------------------------------------------------------
time:   02:31:37
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316129/
log:    http://qa-proxy.ceph.com/teuthology/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316129/

    reached maximum tries (801) after waiting for 4800 seconds

[7316146]  crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/write_fadvise_dontneed}
-----------------------------------------------------------------
time:   00:22:21
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316146/
log:    http://qa-proxy.ceph.com/teuthology/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316146/

    Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage ceph_test_rados --write-fadvise-
    dontneed --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000
    --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read
    100 --op write 50 --op delete 10 --op write_excl 50 --pool unique_pool_0'



Running
=================================================================
[7316130] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/pool-snaps-few-objects}
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316130/

[7316132] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/radosbench-high-concurrency}
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316132/

[7316137] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects-localized}
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316137/

[7316139] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects}
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316139/

[7316140] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects-balanced}
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316140/

[7316141] crimson-rados/basic/{centos_latest clusters/fixed-2 crimson_qa_overrides deploy/ceph tasks/readwrite}
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316141/

[7316143] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects-localized}
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316143/



Pass
=================================================================
[7316131] crimson-rados/rbd/{centos_latest clusters/fixed-1 crimson_qa_overrides deploy/ceph tasks/rbd_api_tests_old_format}
time:   00:25:58
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316131/

[7316133] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/radosbench}
time:   00:39:28
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316133/

[7316134] crimson-rados/basic/{centos_latest clusters/fixed-2 crimson_qa_overrides deploy/ceph tasks/rados_python}
time:   00:28:11
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316134/

[7316135] crimson-rados/rbd/{centos_latest clusters/fixed-1 crimson_qa_overrides deploy/ceph tasks/rbd_cls_tests}
time:   00:24:48
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316135/

[7316136] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects-balanced}
time:   00:26:09
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316136/

[7316138] crimson-rados/rbd/{centos_latest clusters/fixed-1 crimson_qa_overrides deploy/ceph tasks/rbd_lock_and_fence}
time:   00:17:37
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316138/

[7316142] crimson-rados/rbd/{centos_latest clusters/fixed-1 crimson_qa_overrides deploy/ceph tasks/rbd_python_api_tests}
time:   00:39:47
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316142/

[7316144] crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} crimson_qa_overrides deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects}
time:   00:34:20
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316144/

[7316145] crimson-rados/rbd/{centos_latest clusters/fixed-1 crimson_qa_overrides deploy/ceph tasks/rbd_python_api_tests_old_format}
time:   00:33:44
info:   http://pulpito.ceph.com/yingxin-2023-06-26_02:55:58-crimson-rados-wip-yingxin-msgr-multi-core-crimson-8-distro-default-smithi/7316145/